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QUALITATIVE DTEEKEENOES IN Tim 
V()(,‘AiniLAIlY IIKSPONSKS OP OIIILDllEN* 


HKUMAN FKIl'KU 
A<ljuUiit (•(‘iiorars OITicct 

And 

lUVINC LOIKiK 

ToAolicrtJ (*oH<*go, Columbia UnIvorBity 


A. INTUODIJCTION 

I'liti inlimttlc r<'hUi(ni of vo<!ulnil«ry with Lhn tliouKht procosses 
(jf llin indiviiluiil Ijuk Ioiik Immui rer.oKmz^d. Tonntui,*^ discuBsing 
llm Umtulivo revision of tiic Hiiieb'Simon Henia in 101.2, Blntcd 
ilml R rpiniitnUYi'. ivuivlysiH of the. verhivUm <U‘,(»niUonfl of ohilclren 
of ciifforeni uhch nnd meatulily would bo of Kveal value. In lOiO 
Termun’^ found that children of wx years, as u rule, defined 
ubjeetH in (enus of use, ami that it not fjcfarc niKiifc years tfiat 
tw(»-lldrd« of llu; eluMnui HponUmcously guvo a largo proportion 
of delinitions in ienns miperior to iikc. Ho also emphasized tlio 
point tliat [\w typo <if definUion iistul hy the ehild, i.c., wlmthnr 
thought, (pf In terms of uw, appearniiee, material eomprislng it, or 
class rclat»ons\\ip, threw iiilcresliuj!; light on the maturity of his 
uppeiTcplive prticesses, and that one could differonliata at least 
a ludf-iioKcn degrees of excellence in d<Tnuti{)n related to the 
mental level of llie .sulij(;el. He udiniUcd that although the form 
of tlelinilion was important, it hud not l»eeii taken into considora- 
tion in ll>e seoring of the lest. l‘iuget“-’’ also in Itis work with 

• Tlio niitliorfl wip)i l<» «*xnre«» their apprericUion le Amw DinRdHUi', of Iho 
I'Murnlidiml 'IVrtliag Hervit-e, New York, and to I'refcsHdr NieheluH llnhlpn 
of 'IVarhiTrt fVpllrK^', f'elmiihin Uiiiverwily, for umkIiiK avnihihlc llio raw 
ihiU on wlii'-h llils ^(ully is liA'ird. 

t 'Hie vipnv« In ri in HliiU-d <hi not ni'Kiwnrily r(Ul<M!t thoHft of tlio Doi^nrl- 
iiH'itl of lliu Army. 
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The %f0urnat rtf Kdumlwntil 


cliiklrcn allowed lliut \\f»rilhnn» l«iiinrl iiji wiMi r*‘gJiilv?ri find arr 
relal**!! l<> r<jn«’Cj>l fiirnmlitm. 

In U's^linji llit^ nUt'lliKt'ttt'i* »‘f cUikltm hy m'-an^ ‘d 
two rrmin ly|M*s nf v»ir;iliuljir3' Insvi' lsr''<*ii Hia’ 

kind, ridyiii^ t*n rrmli n \n"T'i ! "»U ik*' 

cliihl rnuf*l rr.'*pnnd viitlt mi no'r|»J:iidf* rk tmih^n 'Hm frv; <-,jjd 
varicly, utrr^f^niR iiiiiMlns*»'i>' n jajad 

Him k*iir i»r livi’ iiUt’riiMhvr' witr^la (rn«Uipl<““ria«'jri' i* j Smij-pji>5 
frtiiii wliti’li ll«(’ rliil'I riMW*:**'-*! flu* iii*''-*-t ksn^ »(tn‘ 

Thi^ woriiif^ hyfi«’in uf llif niall fy|H' that fiU rjuld 

unsufTw jirt* tif cfimil vnlin* uimI in3ik**v. im daffi ra nfiids^uri tivi-cii 
a ‘govar ligUl {mr^wir and a lrsK.Uf nut'Vi.vr. v'l.vrjii (»»r 

{M'cnwUiiml hjiif-crcdilt*, m»r il laki* ui*-i hm 'imif Hi*' 
islifuk*??, {jimlily. imd rarigr* nf tia'iimiig,^, 

Till* purpoK* (if llu' pryw'iil Mu*Iy ninif* nl a furflu^r rlfinfs* ?ji!3"»n 
mirl (-•xU'iiHiMii itf our kiiii\iili‘(lR(* runcrming l!i»» Mir4TNf B«.r i-iniirn, 
in rrinci'pf fnnuatiHii mid ilf'Vi*l*«pMirniji1 llnnkuu?, p«f rSid'km 
Ihroiigli a «im»lilalivi‘ of Iln-ir vi-rkalieu r* >p'Ji '* » P« Hu* 

Form 1. Voi'ukuUiry T(*hI of flu- HiU'i .'“•'wJ** 

n. iiKviKW or MTKifAino: 

Aa far luu’k aw UHH f‘ImiiilH-i?** a ciRiuiunnl i'ludy o( 

growili in llu' gonurai tni'aiiitie nf virnknlary wohU 11<* nuli*' 
call'd llml ill Ihr (*aily yi-arw of life wr have jin iir< uraf«- kii'pwF 
edge* of nniy tlHw lliiiigti wiiif-h an* iiio«>i imnu diufu and fuinilvar, 
uud llrnL in wiudying ilic di*v(*Io|irnml of ila? i ljild'u Uf*** of !un~ 
guuge llu* itiuhl fniifful IMd iw found in an mi.’d>%»m of Hi*' ipudiiiy 
and oxpauwiuu of viH’tiUuUiry during lUr* w'lioot yi-tiiH Kitk- 
Patrick^ hinted that groWlh with ug«‘ crniro-*! n«il Midy in tlu* 
Yocftlnilary rungi* iiui id>»o in Iho dmuiriJir of tin* dt-kn>io>n*' 
ftUtielml U) wordH. JliiioL uiid Simon,’ wliliiying llu- di-'i( !..j»- 
imnl of inltdligi in i! in (‘hildn*ii, difH'ovrred llml t lnldh 11 I'f jiu** 
nix doniuHl wurdH in IcniiK of um* and llml it wnw no! Miilil tlo y 
rcHolicd age; nini; llml imiht of the* didinilionw lin y gavi* v.i n* 
fiupnrior teiuw*. Tr)riimii'*-’®lmxleingr‘iiiplmdKi'4l ihc iiniKirlfinro 
of epintitalivi; nwpoiwa in vomlmltiry and llu* m e*! for llu ir 
uiuilyHi«. Marx,® currying euil ii nualiiulivu hiudy of ikv idid 
nfl.y wordu of tlio lOlU Stiinford-liinul v*H'al.uliiry r»n a Itirg** 
group of idiiliirm and mhiU.i, u-purUul liiul ilu* liighr^i ipudiiy 
lypi'H of dcfinllion in u-lufioii In i-lironnlngiod age wuru nf 
Lho uynonym mul gonua vurirty, la,\vi'at oii ila- age tu-ale were 



Qualitative Differences in Vocabulary llesponscs 3 

thoPG clcfiniliotiH using illu&lrulion or cxttraplc, use, and tho repeti¬ 
tion tyiJC-'H of iTspon.sc. Green* also qualitatively analyzed tho 
responses of hcIiooI eliildren and adults on fifty voeabulnvy words 
(forty-live of whieh later became Iho l‘'orm L Vocabulary Teat of 
llie 1037 IleviwMl iStanford-BincL). »>hc luiled that ages six and 
seven were ehuraelerized by nse definitionH, and that tyiies of 
delinilinii liuving lower median ugcH Hum usewerc repidition and 
demon^tral'mn. Gray »n<l ITolmos^ empUnHize.d that tho (diarac- 
ler of the deliiiilirjns altuclied to words changed noliilily from the 
lower to higher gradi's, and Unit the. iieriod from nine to liflecn 
years of age was piirlienlarly productive in tlie iicciuisilion of 
different types of mr'uninK. Ueiebard and Rapaporb/* in a wtudy 
of tin* rcHimnscs of eliildren and udolescenls U> the .Similiirilics and 
DilTereiKM'.s 'IVst an<l othc?r eoneepUial iUans of the Stanford- 
iiinet Seale, found that ‘eonerele’ delinilumH deoreivscul with ago 
and gave plio'e t»i 'fuaeUonar ami then to ‘conceptual' typos of 
definition. WeeliHlcr*’^ (ms slated Unit in dclining a word a sub- 
j(S‘t gave more than iusi Ua mere meaning. ]''rom Lite clinical 
point of view, the clmraeter and (piaUty of tiie. word definition 
given liy the. individual pcrmitled inmghl into his tliougiit 
proi’esse.s. 

Analyni'H of tin* ipudUuliveHludies of vocabulary Htress the facit 
that growllt witli age oeeurs mil only in the voealmlary range but 
in the eliaraeler of tiie w<M'd deliniUon as well, and tliat Uio 
(piulily and eoinph'hmcss of word dclinilion citangc consldombly 
from tho hover to liigber gimles. It indicates UiaL Liierc uro 
many possible wnya of detiiiing u word, koiuo of whitdi an; easy, 
Olliers cnniparulively dillieult. Ihitb a nix yivir old and a four- 
Um'Ii year old know the meaning <»f the. \v<»nl ‘straw.’ Tiie aix 
year ohl deline.s it as ‘slrnw lint,’ the fourteen year ohl us 'dried 
hay.' Gbviously tliere are eharueleristic dilT(M-emi(!.s in thinking 
involved, and yet, in bolli ease.s, <mr jiresent .system of scoring the 
vocabulary lest gives .similar credit to Uie re.'^ponsen. 

c. m>;tiioI) 

1. SvUrtion nf till' Trsl. Tlie F<H’m Ij Slanfonl-Minet Vocabu- 
larv Tc.^l Was i-linM-n becuuse it e.xleiids fnaii the six-yi'ar level to 
the adult level, and tin* deliiiiLioiiH given tu its forty-flvt! words 
allow (pmlilatlve ilili'ereiiees in llie respoiise.s to show tlinuiselves. 
In addition, tin! Test has exeelloiiL Hlandanlization, good inloro.st 
value, and pres(mta a familiar task to the child. 
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thf. jGumd of f:dunt(iontil P^^chohffy 

However, <mn j«liniilrl Iw-ar in minrl llml not nil of llio worrU of 
the T<.*Kt ptTmit n. full rnn^o of quAliialive rlinrcTeiifM?^ Ut r sprf m 
themR<?lvtw in llio verimfim rr«iH>niM*i». Thi« i«? pftftsniSnTly Inie 
for tl>c inf»ro difnculi wur<l« in Iho Wlinron?*; for n wripl jilo* 
'oraiiRc' one can rc]»ly with varl'Uit* lly|»r?« nf accculaM*’ aro werf?, 
e.g., 'colnr' (nviionyin), ‘rilniH fruil’ (synonym ino'liJi«*h, 'yMii 
eat it' (iiw*), rouml’ (i!*vrripii«*n). Ho , llio rorr^oii answer?! 
for a word lik«t *jiiH‘»l«irinr nr<* wfunUy Ihnilod »-» n '•yiO'Mvm «.r 
Kynonynt-lypeofilclinition, e g , or ‘fi«h)jko * 

2. QunlUtidKr Clti^^iftfniinn of Uf’^jHinufs. Oii iho hn-io?* of 
I'cifcVH* work in rlaHs.ifyiiig ihe vntiHy i>( difh-ri'nl iptnhlnlive 
re«panHt!« given lo the woniti **f the Korni I. Vctcahirlary a 
fivefold C|unlil«live claj^ij'ifiruiion nyfUrn wtet net up for 
definilion of every wtarl. Hiu* mlcftorj* ronsi^led of j*ynonym 
typc« of reKpoiise, An<jther incUnled Uftf ntid ilescripiliMn tyiKfl 
of (iofiiiilitiit. were ronilMiie*| i»t-» one rnU-Rory huN-HiiN* 

they wen* found lo iweiir at «p|»roximnl«dy llu* develop*, 
inenlnl level in children. A *hir<l ealigory ronlJiim-d llu* e'^phj- 
natlcm lyiK* of ,V fonrlh one wn« nuule up of <he 

demonstralk'n, ilhu^irnfioit, inferior l•\plnfla^itOI. mid repri»iii*n 
typea of re^ponw*. 'I'lieM* were iiu-lMded logrilirr l-c'cnowe 
ompirical lumlyKiN nl^^o indirnpHl ilmi ihey t»rrurn“il at nUoui ilu* 
RAmfi (leveiopmental level. 'Hie final enleRfiry* wnw e<>nipo>M^i| 
of all types of error riTipniiH*. Tlirw eii!eg<triira were kepi luu- 
form for the entire li«t (»f forly-five \vordi«. Here are exHihpIen for 
each (jf the five cutegoriea: 

/vym»HV»n C'ol^frtfv 

(«) Synonym nnmoiHriMl: OmnRe « nfrnil 

(b) Bynonyni riifKliOcd hy Straw *• Jmv Pint 

fc) Synonym incMlifi<'d hy deseriptmii: (Jown «« l•l^a dicsw 
ld> Synonym by and Kyt-Wh -• Imir ovrr ibr ryf* ihai 

clescriplidn: lirofe^la ymi 

(e) Synonym qutiliri(Hl nn lo degnje; Tap » iou<'h llftlilly 

r'flf, iietrripiiun, an>l ond tittmiphnu 

(«) U»05 ftfAliR*' vt y<«j (.nl it 

(1j) Dcawriplien: Straw ii'n yi'll»i>v 

(o) Uao and Dearriiilioti: fhaiiK*' ymi ral it «iul ii's rMiiiid 

/'‘tpfontttiun 

I'fiVclt^ ** )i‘it wortli n l«it Ilf iiii.jity 
Skill « iM’iiiK nl»lg lo do ivnnifthui^ 
well 


(n) ICxpliuiAtion; 
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Qnalilalivc Differences in Vocabulari/ Responses 


Dotiomtration, /irpciitwn, /{fuslraiion and fn/erior Explanation Calegory 


(n) Dutrioiinlralioii: 

(1») Itcpnlilifin: 

(c) lIliiHlrnUon: 

(cl) Inferior I'ixplaiinlion: 


For words like tap, eyelash, etc. 
Puddle* «= u puddle of water 
IVicclcsB >= a Rcsni 
BcurcU lioL 


Error Calrffttry 

(Inrorreet DcinoiiHlrnlion, MiNinlnriirvtation, Wrong Dormilion, Clang 
A^^K^teinlion, Uopntilion wUhoiil KxplnntUion, Oiniln) 

(a) Inrnrroet Di'iiirmHlralioiu Kyidaidi « [loinlH to eyebrow 

(b) AfiKinlerpretation: Itngard «=> protects something 

(r) Wrong Di'liniliim: Orange; => a vogetnblo 

(d) Clang AsHwinlion; Hoar = raw; skill « skillob 

(e) Uepelilion williout Kxplanalion: Puddle puddle 

(f) Oriiiis: When the word is loft out 


III nil Ihn IU151P.H UHod in lliia Hludy the Vocabulary Test was 
first adininiHli'i'c.il and scored iiccording to Terman's'* directions 
iiy experienced oxainincm. After checking the quantitutivo 
scoring, ail of Iho vcrbalim word dennilions were rescored in 
leniis of tlie five tiualilulivo categories just outlined. 

3. of Sroritii /,—In mnusuring the reliability of 

r|ualilalive (uiU^gorics a ctjinmon procetluro is to compare item by 
ilcin, or res|HmH(; by responmi, Ihu records obtained when two or 
mon; independent \vork{‘rH record Ihc same behavior, or scoro the 
HUI 1 H' rcHponKCH. Agreement can be coinpuLod in tnrms of por 
cents. To estaldisli Urn vtdiahiHly of llic (pialilativo scoring, 
fifty <jf llie iMiHeH witro reseoved by an experienced examiner not 
HlUM-lally trained in the (piulitativc method of scoring. Kmploy- 
ing the ArringUm* formula where llic response.s in eacii observer's 
scoring that agr<-e with the otlier's (in oftecl, doubling the agreo- 
m(*nls) is ilivided by thin total phis the disagreements (rtj.sponses 
tlisHiniilarli’ r(x;(jrdc'() and rc.Hpon.«(*.-« noUai by one ob.servcr and 
*. 2 X agreements ,, 

l,y lh(. i,..,, 2 X „Krc.ci™,-nl.s + .lisu«reom5nff 
range, of the iier cent of agroeiniMils for Om forty-live words of the 
Test WMH found to (‘xbmd from 1)7 lo 1(10 per cent. They are of 
Hueii an onler l«i signify that the qiialilalivn scoring was carried 
out with a liigij degree of consi.sleiicy- 


• 'i’hi’re wrre iu» ri'-spunsi’H in any of llio llfty eaw’s liolinl by oru! obsorvisr 
and jMil liy llm otlur. Thio part applies eH.-«‘nlmlly to workiirH recording 
obBiTvalional types of behavior. 



n Thr Jimrrinf nf fCiiwaJwnnJ 

S. .^nhpTls. 'rhf u-Mrfi K«f S-djn^lr^'vj 

rliil<3n ji, insilf'nn'i fi mnl*’, raiJaiTiftin ag'- ^lrM!l3!i pn 

toiirlrrij yrar^, uitH hnmlr<’'4 rJiiMim. !r'|i 5 f 4 % 

riivi4r*<l u^i Jm hx. uI r*jir|t y^ar Ifvrl f3a8s« wri-’ Mn-'mii4 

from rjjrrii-il nu* m a ’^;fvrv «*f fnjMo’ in 

K!i>*t4‘in w fllfiring llso y rar* lo I'!.* 82- JOj4 h»‘rji 

Uniliuii lorri' il out hi a4vimrr4 r ;ii 

Tt'jo’lH’rw (‘oll«'R<‘, t'i»nrr!»i*v 4'iiiJn;i l'J8«i -lU’! l*.Hi. 

All tljo I’lnUln ri vv« ri* of llir whtU- Ajih’TO .=311 l orn- ^.uvo 
un iiirli» nl}»*!i uf wiiy «»r j^hvi^iral liau*lj« \V J4»'jii«-v« r 

isiiy ahsf'o u>t to tlj<* vnliilily itf n Irrfti niHoU, Mo' ra.M- 4\fi.M 

iiol 

\i\ lUr' Istft r<-3»Hlls t‘*r UolU k'-pK ftrjra- 

ral<*. .''int o nnaly^j" ‘•lifmi'4 n'* WKiiilis’aii! tdifftr-ni ii> <'-i^ railoT 
ainiiliir |m lurr>^. Oto «M;i f^r llio aiol frrna?t rt> wrro ruju- 
l»iui!tl wu4 tMily ImIsiI «U-Unii«m1i«n», in ikift t» 

rt'p<irU‘tl in iho prr^«'m )»ii|ily, 

I'MunilioiiMl k'vrl «li'h'rmsMi'l hy n-illior ni»n||»k Sn-n or 
iviU“iitl3iuvo in li Tho youris i4 j5« !n*<.Un^ nin^»'4 ono 

U) U n yf3»r?«. 

Tnlilo 1 profi* nL“s iho 1»a« liftr<iiiu<I «ki*a *4 tho lojs*' h’lssiolrrd 
diiUlri'^i nw«l in lUiri >i»i4y. 'I’ln* ilni'iti'n nio vU^ikily 
nvern^v' inifUi^otUT* al »-noU vrAf U*v*4 nl J'.',iasU-« sj 

They \M‘re iiiMiflit 'l uK»iin>t fho r<»iiip*o*ju< I nrm I.M 
(liMnlmlion mul for nu-mi Ui liv jijn«» rijal >ls">u4ot^\;un a'k 
uml hy MrXt nnsr*'’ in Iho ehintinriliiadon •<! she lii jim J .--ij.oi- 

fnnl-IhlH l I'ciilf. The njjr-i of tho rhihin ii r;nJK‘ '1 fr-'in p jv 

Ihrough fourU't'ti, llu* nni«li-f* from I Oir»o!|i)i X, In hsit- f.njjph- <4 
1023 ftir holh Form J, iirnl Form ^^. ^fi'Kcmnr lonl no :»!< KT'* 
of 103.2 Hint 101.0 ainl SlJ’n <4 Iti.S ini>i Hi.O. r« hp'^ l3V<-]>‘. 
Mt'Nrrniir iii'lirjilotl Ihat nirm*lioiirt for the in.oh rornl 

rcprcwniiilloii uml hhi« in lln* oeriiii'iiiniml of !]m- piironlx 
would bring tlit* Uj iiirAnH imn-h fo MM*. d;d:> <4 ilort 

Kliniy, l«K», are Itiusetl iii-Hofitr nti there is lillle rural rrpn a{:U!*.n. 

l>. TIlK.VIAIIlNr ttr IIIK »»A3 \ 

'I'ahli' 2 presents the meatifi iiinl eiiiud.ard th-vialiHii'' ft.r e:o h 
of the live (puilitutive euU'gotiea itl eU‘'h uge level, ‘lie* 'lulu 
dennniMlrult* Ihiil uw the eiiililirii get ohier they un' lie* hym-ay la 
ly|)e>t of reitpunw* iiatreninl iiiori; iiflen, timl ihul iil age nine ami 
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bighf^r Un*y I'ntplny llirm iiMirn* fri-^jnfuiij.v ibwn nuy »4Jn r i> nf 
clpfinilutn. *rb«' >»w !in»J tliwrjiiliMn of raTo stnrn 

morp nflrii ilinii niiy «iI)i«t' ly|a** i»f atrbjms'^ii lyv tlj<‘ > be3<b<-]9 ui 
agea six ^iirl wvcii. 'Dip talalrr rb»)‘lirn„ b'»«<“vrr. 
lejia fremic'ittly Uuuj jjny nihrr lyiw hf rsia -r-j.! sSsr slba?^* 

IraUon, dpmoip'trulU'n, infi“rii>r px|»)3)innSj<*n, srid 
r,ttU‘.gory Iyjm^h «.f 'I’in* rbiUfrm tj-'t- 0s»* »%|d.ar«;a«jM}j 

type «f drfinitiim lt*7i,hl nf till at iigrn wts; UsraanRh iiiiu* yj-fiTh'. LnS w- 
they Rt‘Lolder i bm^HP il mitre ^•fl4■ll ilifin 7tll dJtier «4 n ? 3 souhi- 
except Ibe HSUnnym varmly, 'fhi* lirmimHlrnli'm, ii-jm 
illualralion, timl inferinr t-xiihtmiiimt lyiM ri i>f rrMjtaajsHu^ do not 
appear lo lip given freiiuently nl tiny rige. rbi^ nim ^ ninl l* n- 
year olda give lliem nmn* nfieii ibiiii dn nny i»f tbi“ a.ihcr ngi* 
groups. From age elivni and nji lliiw rii«« Koiy of ri r-pcn '*‘ Ik 
employed Iptta c»fu*n Ilian any other eutegory. I'lie error vatr- 
gory, as waa in la* expR'led. hIiowh a tileady ileeJIne in fretjnen* y 
of choice a« Ihe rhildreJi gel older. 

A Kraphlr pri'senlnliim of the dalii in givi-n in Kigofi' I, It Ik 
nppurenl ihnt nl age^i t>i^ and t<ev«-n the «loldren give i),e ^tiid 
clcHcriiiUtm lypea of re^ponw* mo>.L oflen, ami via* eNphnmiom 
type of deriniliou leawt ofU-n. Al jige« nine and feu, ihe hviionytu 
types of roaponists ore UKcd iiiont freipumly by ilie rlnldren, the 
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AQS 


I'in, 1. Nfr'in nf ten* of live ralj-Korii-.H hy iigo. 

\ 1 H(‘ (iihl ripl inn lypc.s (if an; Kiv(‘n 1 ('hh fiviipxMilly 

limn at aix and seven, and the oxphumlion lype of rcHponsi: 

ia Kiven iiieveasiiinly more <ifUMi. From ago olovon and up, tho 
(iltildren very definitely usu lh« Rynonyiu types of response most 
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TAnufi 3 .—SioNirirAN*.'!!: or thk DirrMirxiRf^ nivra^rrs YorN*?»!R awo 
Ou>B;>t Cmildmrn nt A^k riRcicr^ om STxr»?cTM Tti-rs or 
(X »» ron KirH Aor <'•«<>! ri 
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1)\ «■ liinrrfnrn Iwlwron nlAwinn^ invnnx for njst>' W moJ 7 
* *» SiKnifi''iint nt .01 It'vol. 

— “ ^ll^llH vnlupH HiilipRlr (Imt llir «lifforrMr»* h iu fjivor t>f rtK“ 
group. 

oflcn. Tliry followrd m ln*qii«‘»ry nl iw* l«y Oio i*\|(lu»:iiinti 
lypu uf dcifniUion, llw* uh 4‘ uiitl ilrucripHoK kinds of n-i^pMii ••, and 
finully, llio d(Mnoi]»^lriUi(tn, iliiiHtiutMMi, iiiforinr < ^phinttlinii, ;iiid 
repctilion Lyport of rr.*<iH»nsi*. 

1 . SiQuificoul Dijfcmicea in Qmlihiiivc lit'Kpuiirrs lirUnm 
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VoNNy/r nuii Olihr ('hibinn.- h\ «i<lpr lo diHrovor wliotlior Ihoi'C 
won* any biiitiilii'anl difiVmioos liolwoon tlu* typo of qimlilalivo 
(lofiiuiiiina i^ivcii liy tho yoiiii^rrr cliildroii sia Rf^ainsl llto older 
ones lo iIh* forly-livo Wfinis of Iho A’opulujlaiy Tosl, llio iiU‘air 
dilforciico^ wen* dolormiiml for oarli ojito^ory at al) ano 1 (!Vo1h 
and an ovalnalioii made nf ilio HiKiiilii'iinro of (1i(‘ho dilTiaoncoa in 
lonoH of Iho hlamlaitl orior of llmir dilToronroH. 'I'lio ichuUh 
appi'ar in 'I'aMoaH, -I, 5, li, and 7. 

'ral*l(‘ li pn•^•onlH lloi ro.suUa for llu; Kyiionyin lyi)Da of renponao 
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— «» ^{inuH valuer itnUettle llml Ihe iliffrrrnr« ih in fnvur «•! r nRf* 
group. 

and iiulicnl<!.s Dial Urn older children HKiiilii .niiily innr.* ufnn 
employ this lype of dclinilioii than do lln* y«nnitt«-r rhildn ji. 
This holds Inio for each KiiececMliiig year l«*vr l fr*>m .i\ and 
up C!X«,fcp\, Ivttlsvcen Uw^ ivrc. IwcU of vVvvn and thir 

teem and fourU'en. 

Tho dftU for Iho uw! and drwriplion lyiM^w n i-pi.im** aiiih ar 
in Tfll)le 4. Tliey show Uiul llie yonnK‘‘i' cliiMim. nui* i-i\ 
tljrough nine yonra, aignificnitlly more oflon give lljr.tf lyiM i^ nf 
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di'liniloio lli»n lin lln- ul«l<‘r (‘liihlion, olijvon lliroUKh ((MU'tcon 
yoiti'H. And !dlIiouij;)i no hignidi'iini ditTi'ronco.s iimoiiK Iho 
older idiildren, lliere Im u ^^I'ni-nd ti'toli'iiey for tin! thirteim- and 
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TXBliB 7.—SiaNIPICANCB OP TnB DiPFBREKCES BETWEEK YoUNOSn AND 

Older Chjldren by A.ob Groupb oh Error Tybeb op Ukhponbb 
(N “ 100 FOR Each Aob Group) 
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5.0 

3.9 

2.3 


14.ot 

o.ot 
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13.4t 

o.it 

6.7t 
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* = Significant at .06 level, 
t » Significant at .01 level. 

— = Minus values indicate that the diltorencc is in favor of the older age 
group. 


years employ this category of definition responao signilicaully less 
frequently than do the older children, ago Uui through fourteen 
years. The twelve-, thirteen-, and fourteen-year olds Hoom to 
uso this type of response about equally. 

The results for the demonstration, illuRtrution, inhu'ior (‘.x[)lana- 
tion, and repotition types of response appear in 'J'uble (i. Tluiy 
show that the six year old children give these lypo.s of dclinilion 
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significantly less often than do the older children except for the 
fourteen-year olds, and that the nine- and ten-year old children 
employ them significantly move often than do the six- and seven- 
year olds. However, the eight year old children use these types 
of rpsponsG significantly more often than do the fourteen-year 
olds, as do the nine- and ten-year olds ^yhon compared with the 
twelve-, thirteen-, and fourteen-year olds, and the eleven-year 
olds when compared with the fourteen-year olds. It should also 
be reealled that these types of definition are given less fre¬ 
quently by the older children, age eleven through fourteen years, 
than any other qualitative category of response. 

Table 7 presents the findings for the error types of definition 
and shows, as expected, that they are made significantly less often 
by the older cliildren than by the younger children. These sig¬ 
nificant differences hold true for each succeeding year level from 
age six and up, except between the ages of thirteen and fourteen 
years. 

To illustrate some of the dilTcrenccs found in the qualitative 
responses given to the words of the Vocabulary Test by the 
younger and older children, a few typical definitions are listed 
below to the following words of the Tost, i.e,, ‘puddle,’ ‘tap,’ and 
'gown,' To the word ‘puddle’ the younger children responded 
witli answers like the following: ‘a puddle of water,' 'mud,’ 
‘what you step in,* nto. The older children responded to the 
same word with definitions of the following kind; ‘a small pool 
of water,’ ‘water that gathers after a rain,’ etc. To the word 
‘tap’ the younger cluldrcn gave replica of the following variety; 
‘lap your foot,' ‘tap on a door,’ demonstrated the action with their 
fingers or foot, cto. The older childi-en gave definitions of the 
following kind to the same word: ‘a faucet,’ ‘a light knock,' 
'kind of a rap,’ etc. To the word ‘gown’ the younger children 
responded with definitions of the following type; ‘you wear 
it,’ ‘nightgown,’ ‘what you sleep in,’ etc. The older children 
responded with answers of the following kind: ‘an evening dress,' 
‘tt long dresB that women wear,’ ‘a beautiful dress you put on 
going to dances,’ etc. 

It slunild cautioned, however, that no particular type of 
definition rnsijonsc is the exclusive possession of any specific ago 
group, or, for that matter, any group. 
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B. macUBHlON 

SigniCicant diffevcncca have been dcmonslniti-d in llio ([ualita- 
tivc types of response given by younger chililren when eniu|iared 
with older children of Bimilar imekKnmnd. Anaiyj*i.s of llieir 
verbatim reapoiiaea shows that the «l<ler ehihlrrMi sigiiificunlly 
more often use the explanation and Kynonytn lypl■^< of dofiniHoii, 
wheveaa the younger children wgnificimlly m<we. oflcu <'inpU»y 
the use and description, niul demonstraliou, ilhmlratifm, inf»M'ii>r 
explanation, and repolitioii typos of r(!sp<»nso. T)u>.sr* limlings 
substantiate the worlc of Jlinct and Simon’ and 'I'ornmn*^ 
who found that tlic use typo of definition is most froiiuonlly 
given by children eight years of age and yiningor. In addition, 
they confirm Green’s® worlc in showing that uhc, doKoriplion, 
repetition and demonstration tyi)C» of icsijonwi are mon? oharar- 
teristio of younger than of older cdiiUlrou. The roHiilU 
support tho findings of Piaget'*-** and Reiclmr<l and UapaporL'* 
in evidencing changes in tho concci)tual level of developitn-nt (»f 
cliildron as tlicy grow older. To tho younger clnld an 'orange' 
is 'what you eat' or Tt's round.’ Only as ho growa olilcr <li)er< Inr 
SCO it as a 'citrus fruit’ or ‘a fruit whieh grows in (hdifornin nr 
Florida.' Obviously, characteristic difTorenL-es exist in Die 
thinking of younger cliildron when they arc eoni))ared wbli idder 
ohildcon. 

The younger children tend to pcrcoive words as ef)ner(!U' ideas 
and do not gcncializc. They emphasize llm purlieuliir or iso¬ 
lated aspect rather than llio categorical or 'I’laHs' feuluni of llio 
meaning as older cliildren do. A '|iu<ldlc’ means 'mud' rallun’ 
than a ‘small pool of water,' and ‘bIvivnv’ is 'yellow' ruilu'r than 
‘dried grass.’ This emphasis of younger (diildron on lla*. eoncrole 
approach as evinced through their word definitions willi a per¬ 
sonal rather Ihan symbolic outlook showa Htrikiug similarity to 
the qualitative types of definition given by abiiunnals. Feihd,'* 
employing the same fivefold qualitative Hystoin used in ihissliuly, 
demonstrated that in response to tlic words of the Fonu L Stan- 
ford-Binct Vocabulary Test abnormals, when coinpansl with 
normals similar in background, signiiioanUy more, (»flen gave 
the use and description, and dcmonslraliun, illuslruti^in, inferioi' 
explanation, and repetition types of dcfinilion Lhun they did tho 
explanation and synonym typos of reaponau. 
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Since there is a definite relation between age and the types of 
qualitative definition children uae in defining words, and ainoo 
the method of approach used by individuals is as revealing as the 
mere passing or failing of a word, study of the qualitative pat¬ 
terns of response given by children to vocabulary words can throw 
light on the conceptual level or mode of thinking of the child. 
This may prove helpful in supporting and supplementing other 
data we possess concerning the child’s thinking processes. 

F. SUMMARY AND CONCUUBIONS 

1) The Form L Stanford-Binct Vocabulary Test was admin¬ 
istered to nine hundred children between the ages of six and 
fourteen, and qualitative analysis made of their verbatim 
responses by means of n fivefold qualitative category system. 

2) Significant differences were established between the qualita¬ 
tive responses given by the younger children as against those used 
by the older children. The younger children significantly more 
often employed the use and description, and illustration, demon¬ 
stration, inferior explanation, and repetition types of response, 
whereas the older children significantly more often used the 
synonym and explanation types of response. 

3) Characteristic differences exist in the thinking of younger 
children wlicn compared with older children similar in back¬ 
ground. 

4) Younger children perceive words as ‘concrete’ ideas and em¬ 
phasize their isolated or particular aspccte, whereas older children 
stress the abstract or ‘class’ features of the word meanings. 

6) Strong similarity is disclosed between the qualitative re¬ 
sponses given to the Form L Stanford-Binet Vocabulary Test by 
younger children and abnormals. 

6) Qualitative analysis of the vocabulaiy responses of children 
can serve as an aid in supplementing other sources of data con¬ 
cerning tliG child's thinking processes. 
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THE RELATIVE EFFECTIVENESS OP MASSED 
VERSUS SPACED FILM PRESENTATION! 

PHILIP ASH 

Tiic Pennsylvania State College 
INTRODUCTION 

While the average classroom lecture is usually between forty 
and sixty minutes long, and the average entertainraent film lasts 
eighty or ninety minutes, the typical instructional film is designed 
to run exactly ten minutes. A wide variety of factors contribute 
to this situation. As a practical matter the instructional film 
producers have more or less tailored their films to fit the standard 
400-foot reel for 16 millimeter projectors. Films are frequently, 
perhaps usually, designed as instructional aids, to assist rather 
than supplant the lectures. Beyond these reasons, however, is 
tlio often expressed feeling that longer films are inefiective 
teachers. 

These limits may be adequate for ordinary school practice. 
In largo mass training programs, however, such as those con¬ 
ducted by the Armed Forces, the question of how long film 
sessions can last and still he effective often arises. Laclc of 
jnslj’uctoj'a and probJcjws of scheduling frequently mahe it 
desirable that sessions much longer than ten or fiftcon minutes 
bo arranged. 


STATEMENT OP TUB PROBLEM 

The experimental problem may be staled as follows: Given a 
body of information that has been translated into films, do 

i Abstract of a di-saortation submitted in partial fuHillincnt of tho require- 
menta for the degreo of Doctor of Philosophy at The Penneylvaiiia State 
College, Jimc Ill'll). Tho re.soarch wns made pos-siblo by a fellowship grant 
from Tlio InstriicLioiinl Film Ilc-soarch Program, The Pennsylvania State 
College, imder eoiiliaet with tlio Spocinl Devieca Center, Ollicc of Naval 
KoH(;artih, Navy Doparlmi'iit, Coiilrnct No. NGonr-209 T.O. VII. Cvatcful 
neknowledgment is iimdo horowilli to the i)erBoniU!l of the Film Ue.soareli 
Program who aid(!tl in tho study, and to tho instructors in Lho Doptu Lmcnl 
of Psyoliology at Tho Pennsylvniua Stnto College ami the oJlioors at tho 
Great Lakes Training Station, Great Lakes, Illinois, for making teat popu- 
lationa available. 


10 



20 The Journal of Educational Peyclwlogj/ 

people leftrn more if they are presented with tliis content in one 
long film in a single session, or if they are presented witli tlio 
content broken up into several short units in two or more scsHlons? 

A variety of secondary questions were studied in connection 
with this central one. Of these, the prlncii)al one was: Is thore a 
diminution in intcrcHt as tlio length of film w.^sions is in(nvaK(!cl? 
If 80 , What rclationshiv^ ib there between learning and interest aa 
film length is increased? 

To obtain an answer to these quest-ionH, two indepciKlcnt 
experiments, one with eleven classes of uiulergruduntc psyolu)logy 
sLudents and the oilier with ten companies of Navy rccrulla, 
were undertaken. 


I'KOCEDUKEtt 

Psychology classes' ex-periment .—The first oxporiniont was the 
one employing the psychology fltudenls. The cloven classes 
each included between twenty-nine ami sixty stmlcntH, making a 
total sample in. excess of four hundred. For this population, 
two sci'ica of films wore Hclcctod. One was W. N. Kellogg's 
Ape and Child Scries. The firal four title.s in this series wore 
used. These films present a comparative study of maturalion 
and learning in a human infant and a cliinipan{^(;o.^ 

The other series was J. 11. Mnssermun’s 7'he Dynamics of an 
Experimenial NeurosisJ The four reels of the sorics (jon.stituto 
a unit on the dynamics of experimental neuro.sis in cals an<l 
therapeutic methods used in alleviating tlio neuroals. 

The Ape and Child Scries was shown during March, 11)‘18; 


*Tho lUlca used included: “Somo Behavior ClmraeUTiHlicH of a Iluinau 
and a Chimpanzee Infant in the Same Environment,” ''('ompartitive 'IVhIb 
on n Unman and a Chiinpniizco Infant of Approximately llin Hame. A^e," 
"Experiments Upon n lluinaii and a Cliimpanzcc Infant afler .^ix MoiUhs 
in tlio Same Environment” and "Some General Itcnelions of a Unman and 
a Cliiinpanzco Infant After Six Months in Iho Same ICaviromnonl.” These 
were all silonl, bluok-and-whito films. Tlio overage niniiiiiK limn nas 
14.6 minutes. 

*Tho litlos used worn: ”Coiidilioaod Eccdiiif; Behavior and IniliKUion of 
Experimental Neurosis in Cats,” “Effects of Enviroumvalivl b'rualvnlionK 
and IntonBifieation of Connicl in Ncurolio C'ats,” “lilxperiiiumlal liiminii- 
tioa of Nciiiotio Behavior in Cals,” “Active Participalion in I'^lahliHliiaj^ 
Moi'o Satisfactory Adjusinicnt.” Theso were all silent, blnek-nml-wliilo 
films. Tlio average running lime was minutes, 
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tho Cal Neurosis Scrios during April, 1948. Three classes wore 
each shown each scries in a single long session, lasting approxi¬ 
mately ono hour (1-Parb Method). Two clasBcs were shown each 
scries in two sessions, two reels per session (2-ParL Method). 
The sessions lasted approximately thirty minutes each, on altor- 
nato days. Two classes wore each shown each series in four 
sessions, one reel per session (4-Pnrt Method). The sessions 
lasted approximately fifteen minutes each, on nllernale days. 
All sessions were held during. regular class periods. With one 
exception no class was shown both series in the same spacing 
pattern. 

Immediately at tho end of a showing, of one, two, or four reels, 
tho grouj) was asked to fill out a rating form intended to yield 
some information aljout the clTect of film length on interest. 

One week from tho midpoint of tho showings, in tho case of 
tho Ape and Child Scries, a 78-itein multiple'choicc tost based 
on tho film scrios was administered to the seven experimental 
olaasQS, and to four classes who served as a control group. Tho 
latter took tlio teat without having scon tho films. 

In tlio cage of tlio Cat Neurosis Series, an 80-itom multiple- 
choice test baaed on the film series was given to ono class in each 
methods group two weeks after tho mid-point of tho showings, 
and Lo tlio other classes one week after the midpoint of the show¬ 
ings. Tlic four classes who served as a control group for the 
Ape and Child Series took this test also.* 

The comparability of tho eleven classes with respect to initial 
status was determined using as criteria the all-collcge grade 
point average and the final psychology couisb grade of each 
subject. 

The Navy experiment ,—The second experiment was conducted 
in August, 1948, at the Great Lakes Naval Training Station in 
Illinois. In all, ten companies of recruits, each numbering 
between sixty and one hundred men, were used. 

Two film Sfjrie.B were selected, each comprising three reels. 
One was a scries on liulcs of the Nautical Road. The rules 

*Tl\o roliahililioB of tho loats worn estimated by tlio Kvulor-Richavdson 
moDiod of ralioiml eqijiv/iloneo. Use wfl.s inndc of Llioir Fonniil/v 20, Tho 
reliability of tho Ape ami Child Series tost, baaed on Ihn scores for all sulpccts 
in tho cxpcriinontnl group, was .61. Tho reliability of tho Cal Ncuroais 
Series test was .73. 
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covered dealt with '‘Visual Bay SignnlH/’ “Whistle vSignaia for 
Approflchmg Steam VeeaclB,” and "Ijiglita of VesaelB Being 
Towed." The other aericH was on ElemenloTy Hydraulics. The 
reels used included “Applications of Bascars Baw/' "Charactcr- 
ietica of Liquids in Motion” and "Simple Hydraulic Systema.” 
These were all Hound films, using nniniatiun throughout. Tlio 
average running lime was fifteen iniiiulcH. 

Bor each scric.s 40-item multiple-choice U*hIh were couHtructed,* 

Bivo of the ten companies were assigned to each him series. 
For each Borios, two coinpanicH saw the three rools in a singlo 
session lasting about forty-five luinulca (l-Purl Method), two 
companicB saw the three reels, one reel at a lime, in three seBsions, 
each 8cs.sion lasting about fifteen mimilcs (3-Part Method). 
One company served as a control group, taking the tc-st without 
seeing the films. In the spaced or S-ParL I^lcthod groups, the 
intervals between the HCfwiona could not he held eoiiHlanl, They 
were approximately twenty-four lioiini long, hut for one company 
the two intervals were three hours and Isvo days, respectively. 
No company participated in seMiona for both film Rorioa, 

As in the psychology replication, at the cnil of euidi kchhIoii tlio 
group was asked to fill out a rating form, anti one week after the 
midpoint of the scries each company was Icstcd. 

The comparability of the companies with respect to initial 
status was determined using as criteria score.s on Die Navy 
General Classification Test and the Navy Mechanical Aptiludo 
Test. 


FINDINOB 

Comyarabilily of the groups.—Tabic 1 presentR the means and 
standard deviations for the control and experimental groups for 
each film scries, for the two matching variables used in each 
case. 

The psychology groups wore somewhat more variable with 
respect to the mean final psychology course grade than wiLli 
respect to the grade-point average. In tlie former case, the 
diffcroncea among the groups wore rngnificant at the (ivc per cent 
level of confidence, for both film series. Tlio differences in grade- 


®Thc Kudor-Richardson rcliabililica for these teals wero! 72«/ca of Iho 
Nautical Road Sorica tost, .67; EUmentary Uydraulica Series lest, ,80. 
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Table 1.—Means and Standard Deviations for the Match¬ 
ing Variables for the Control and Experimental Methods 
Groups in Each Film Series Group 

A. Psychology Classes Population 


Melliod 

Apo and Child Film Series 

Cat Neurosis Film Scries 

No. of 
Cases 

Cirndo-Point 

Avg. 

Final 

Psychology 

Grado 

No, of 
Cases 

Grade-Point 

Avg. 

Final 

Psychology 

Grade 

Mean 

SD 

Mean 

SD 

Mean 

SB 

Mean 

SD 

Control 

105 

1.40 

.04 

1.21 


159 


.04 

1.23 

.88 

l-Pnrt 

111 


.00 

1.41 

.98 

108 

1.44 


1,27 

.03 

2-Part 

101 

1.26 

.01 

1.44 

.81 

GO 




.93 

4-Part 

83 


.05 

1.55 

■ul 

73 

1.33 

.54 

1,62 

.81 



F « 5 

.44 

F = 3.01* 


F < 1 

F = 2.00* 


B. Navy Population 


Elomenlary Hydraulics 
Film Series 


Method 

No. of 

Cnsr.s 

Gen. 

Class. 

I'csl 

Mcchanicni 

1 Aptitude 
' Teat 

1 . 

No, of 
Cases 

Gen. 

Cla-ss. 

Test 

Mccimnical 

Aptitudo 

Test 

Mean 

HD 

Moan 

1 SD 

Moan 

i SD 

■Mean 

1 SD 

Control 

■1 

52.70 


MB 

9.23 

81 

50.50 

11.03 

48,92 

10,67 

1-Parfc 

HI 

51.38 

mE 

48.78 

iTnni 

mm 

51.40 

m»tsi 

40.76 

10.30 

3-Part 

mm 

laqIH 

9.42 

48.07 

1 9.32 

■n 

40.55 

|10,14 

EK»M>1 

8.78 


m 

F « 

1.34 

F < 1 

jH 

F = 

1.40 

F « 

1.06 


llules of the Nautical Road 
Film Scries 


Signiricant at tlio live per cent level of confidence. 


point average were not significant at the five per cent level. 
Furthermore, the (dasses within each group (experimental method 
or control) did not depart Hignificuntly from homogeneity with 
respect to either the grade-point average or the final psychology 
grade. 

There was no ovidonco that the Navy groups (or the two com- 
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panics within each group) differed significantly eitlier in mean 
General Classification Test score or mean Mcclianicnl Aptitude 
Test score. 

Inler-melhods differencea.—For all four film series, the inter¬ 
methods differences in total test score, at the end of one or two 
weeks, may be attributed to chance fluctuation. Table 2 pre¬ 
sents the film test menue, standard errors, and slimdard devia¬ 
tions for the experimental and control groups for ciicli film seric.s. 
In each ease, the F-ratio for the experimental methods groups 
falls short of significance at the five per cent level of confidence. 

The difference between the experimontiil and control group.s, 
however, is in each case significanl at the one per cent level of 
confidence.® 

Finally, for the Cal Neurosis Scries a compaiiaon was made 
between the one-wock and two-wcok retention groups. Tliis 
difference was significant at the one per cent level of eonlidenee 
(F-ratio of 12.78). It may be noted that tlic two-week rclenlion 
group was somewhat more variable tlmii the onc-wcek group, and 
that the 1-Pavt Method group, when Icslcd at Urn end of two 
weeks, showed a loss relatively greater than tbal for oitbor of the 
other two methods groups. 

An analysis was undertaken of the rosulU on the subtoHlH 
(one for eacli reel in each scries). In general, the coneluhionK 
based on the total teat score apply cquolly to the snblesL Hcnro.s. 
A highly significant difference was found between tlio experi¬ 
mental and control groups, and in almost all cases no siguifieunt 
difference among the mctliods was noted. Ilowi'ver, for one 
subtest for the Cal Neurosis Series and for two subte.sls for Urn 
Ape a7id Child Series, the analysis indicated variation gri'ator 
than can be accounted for by chance factors alone. In one of tlio 
Ape a7id Child Series subtests the difference in mnans was in 
favor of the massed (1-Part) presentation; in the other two 
instances the differenco was in favor of the spaced pic.scnlalionH. 
Since these findings are based on sublcats including only tw(‘nly 
items, and since the bulk of the evidence is in the other direetion, 
they cannot be considered as seriously disturbing the Klabilily 
of the principal conclusion. 

•Theso F-ratios wore as follows: Ape and Child Sorics— 2'i28.010; Cal 
Neurosis Series— 602.202; Rules of the Naulical Road Scries— SO.-nO; 
Memenlary Hydraulics Sorics—03.830, 
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Taulb 2.—Summauy of Film Test Scores: Means, Standard 
Ennona op Means, and Standard Deviations 
A. Psychology Classes Population 


Method 

Ape and Child Series 

Cat Neurosis Scries 

m 

Mean 


SD 

No, 

o£ 

Cases 

Mean 

SE. 

SD 

Control 

1G5 

31.G 

.41 1 

5.2 1 

159 1 

22.5 

.33 

4.2 


One-Week llclention Group 


1-PtU’t 

111 

54.3 

.44 

4.7 

02 

38.6 

1.00 

8.5 

2-Part 

101 

55.1 

.44 

4.4 

37 

39.3 

1.3i 

7.8 

4-Part 

83 

55.0 

.62 

4.7 

23 

40.7 

1.40 

6.9 



F < It 



F < It 



'rwo-Wcek Retention Group 


(HUH 

mm 


mu 

■ 

47 

34.2 


8.2 






32 

37.1 

^^9 

8.3 

InMIfl 





50 

37.3 

1 1.21 1 

4.8 

mm 

■ 


mm 

■ 


F - 




B. Navy Population 



llulcH of llic Nautical 
Hoad Series 

Elementary Hydraulics 
Scries 

Method 

' No. 

1 



No. 





of 

Cases 

Mean 


SD 

of 

Cases 

Mean 

SE„. 

SD 

Control 

84 

12.0 

.33 

3.0 

109 ; 

14.7 

.23 

Bm 

1-PtVl'l 

193 

JO.5 

.35 

4.8 

190 

19.5 

.22 


3-Part 

159 

15.7 

F = 

.34 

2.50t 

4.2 

152 

20.1 

F = 

,26 

1.06t 



t F-iatioa rufer to tlio experimental method!) groups only. The com¬ 
parisons between the experimental and control groups arc given in the text. 
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The effect of inilial status. —It haa already been demonatrated 
that the groups did not depart significantly from liomogcneity, 
except perhaps in one inetance, with respect to the ‘initial status’ 
or matching variables, considered individually. The question 
remained—When these variables (grade-point average and 
final psychology grade for the psychology groups, Navy Genera! 
Classification Test and Mechanical Aptitude Test for the Navy 
groups) aro used jointly to define initial status, and the gnjiips 
are matched by means of an analysis of covariance, do Hignificant 
differences emerge as between the prcscnliition incthodH? 

It was found, first, that the multiple correlation between the 
film test score and the two matching variables was gimcnilly 
low.’ Second, when the variance estimates were adjusted to 
take into account the regression with the matching variables, 
there Avas for cacli test a alight reduction in the eslimatc of error, 
but in all cases the F-ratios remained well below the five per cent 
level of confidence. In short, the lack of difforonccs among the 
experimental methods cannot be considered an artifact of initial 
differences among the groups, at least with respect to theso 
matching variables. 

The interest raiings .—^Thc interest rating riiioHlionnairoH wero 
devised and administered on the IrypothcBis that, even though 
the massed film presentation might not yield loss learning than 
spaced presentations, subjccU in tho massed (J-Part) groups 
would report less interest than subjects in tho spaced groups. 
It was thought that the satiety achieved in one long period would 
result in a higher frequency of negative re.sponsos to such (pie.s- 
tions as, “Would you like to sec more films in this BcrieB?" and 
“Did these films hold your interest all the time?”, Limn would bo 
the case in the spaced presentations. 

This hypothesis was not consistently Bustnined hy tho finding.^. 
Table 3 presents the mean ratings for each session for each experi¬ 
mental method for tho four-film series. In the Navy population, 


7 These multiple correlations were ns folloivs: lictwcpii Ape ami Child 
Series total score, nud grade-point nvorngo and fmnl pHyoholnuy urtwlc. .2U; 
between Gat Neurosis Series total score, and grade-point averngo nnil lltinl 
psychology grado .23; between Rules of Ike Nautical Hand HorioH total Hcore, 
and Navy General Classification Test and Mechanical ApliUido Tost .<12; 
between Elmenlary Hydraulics Series totol score, and Navy (lonernl 
Classificatioii Test and Mechanical Aptitudo Teat .02. 
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Table 3.—Mean Ratings and Correlations between 
Ratings and Film Test Scores 


A. Psychology Classes Population 


Method 

Film 

Session 

Ape and Child 
Series 

Cat Neurosis 
Series 

Mean 

Rating 

SD 

r+ 

Mean 

Rating 

SD 

X* 


First (only) 

15.1 



11.1 

2.6 

.20 


First 

16.1 

Im 

mm 

13.1 

2.8 

.43 


Second 

16.2 

l.G 

BQ 

12.7 

2.9 

.25 

4-Pavt 

First 

14.4 

1.0 

iHQ 

13.6 

1.7 

.02 


Second 

14.2 

1.4 

BR 

12.1 

2.0 

.08 


Third 

14.1 

1.4 

.10 

13.3 

2.1 

.13 


Fourth 

14.4 

1.4 


13.4 

1.9 

.10 


P. Navy Population 


Method 

Film 

Session 

Rules of tho 
Nautical Road 
Series 

Elementary 

Hydraulics 

Series 

Moan 

Rating 

SD 

r* 

Moan 

Rating 

SD 

r* 

mm 

First (only) 

3.5 

n 


3.3 

1.6 

.09 


First 

3.6 


.14 

3,4 

1.5 

.17 

mm 

Second 

3.0 

1.4 


3.0 

1.4 

.16 

m 

Third 

3,9 

1.4 

.11 

3.9 

1.4 

.11 


* Corrolation I)f!t\v(!on rntiiiR luid Hooro on tlin subtost (or tests) for tho 
film or filriiH hIiowii diuiiiR ibo period in wliich Ilut rating waa made. 
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the mean rating scores for the massed scHsion \sx*ro sliglilly lower 
than the means for the spaced sewionH, by a fiactioii of n point. 
However, lor tho Jinks oJ the Nautical Road Berien, ilie diiTerenees 
among the massed session and the first and second spaced sessions 
were not significant, while the third Hpuced w'ssioii was given a 
significantly higher mean rating (3.11) than oilhcr of llie <ith(‘r two 
spaced sessions or tlio massed se.'^.sion (3.5, 3.0, aiifl 3.5, rcHinu!- 
tively). In tho case of the Klcmcnfary Uydraulirs HoricH tlie 
mean ratings for both the second and Uuvd Kpuc.c'd hokhIouh (3.U 
in both cases) were Bignificttnlly higher (liaii llio moiu»8 for the 
massed session (3.3) or the fii-sl spaced Bcssion (3.4). 

In tlie psychology classes population, for the Ape and Child 
Series the means for tlie massed and Uic 2-part spacod scKsiona 
were both higher than tho means for the d-parl spaecfl ses.-^ion.s, 
while the reverse ivas true for tlio Cal Neurosis Seric.s. Fijrtlu*r- 
moro, analysis of the data showed that intra-8(‘ssion vnriahiliiy 
(differences between tho classes or Navy compaiiic.s (‘X{)o.H(‘d to 
the same treatment) was gonorally as great as, or greater than, 
inter-session or intcr-mothod variability. 

When tho scores on the film to.st3 w'cro eoiTcdatcul with tho 
ratings, a near-zero rolalionalnp was found. Tho distviinjiion of 
responses to the specific qiinstums on tlic rating form nlK(» failed, 
except in one instance, to provide any consistent difTormiiiiiUon 
among the methods. This exception wms provided by tlio data 
on tho Cal Neurosis Series. Of the subjects seeing Ihi.s serioH, 
sixty to eighty per cent in each class in the massed (I-part) grovip 
rated the session 'too long,’ and tbirteou to twenty per cent raU'cl 
the two-part sessions ‘too long.* For the other series, no more 
than ten per cent, and usually five per cent or les.s, rated any 
session ‘too long.' 

In general, then, the ratii^ did not adord a incaixs of differ¬ 
entiating among the experimental groups, and intere.st, a.s rated, 
■was relatively independent of learning accomplished. 

BUMMAnY AND CONCLUSIONS 

Two foiir-reol scries of instructional films wore shown to under¬ 
graduate psychology students. Each scries wan presented in 
three different spacing patterns: four rods in one hour, two reels 
in each of two half-hour periods, and one red in each of four fif- 
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tecn-minute periods. Two three-reel series of films were shown 
to Navy rceruiU, in two spacing patterns: three reels in one 
forty-rivc-miTinlG period, and one reel in each of three fifteen- 
inimitc periods. All experimental groups were tested, one or two 
weeks after Llio films were shown, and each group rated the films 
at tho end of each session. In addition, for each scries a control 
group tiiat had not seen the films was given the test. 

Inter-methods diO'emtees. —For nil four series, tho inter-methoda 
dilTorences in total to.st scores, at the end of one or two weeks, may 
be attributed to clmnce fluctuation. However, the difference 
between the one-week retention group and the two-week reten¬ 
tion group was significant at the one per cent level of confidence. 
In general, these results apply equally to tho scores on the sub- 
tests. For every series, the dilTercuce between the control and 
experimental groups was highly significant, indicating that learn¬ 
ing took ifiace. Tho lack of differences among the presentation 
motliods could not be nltribiilcd to initial differences in the 
groups. 

Interest ratings. —In general, intro-session variation and inter¬ 
company vavialion were as great as inter-method variation. 
Analysis of the <liKtril>uUon of responses to tho questions on the 
intcro.st ruling form failed to provide any consistent means of 
dincveutlaV’mg among the metiuvXft. However, lot the Cat 
Neurosis sorirs bcilwecn sixty and eighty per cent of tho subjects 
rated fclio ono-hour (ina.saed) session ‘too long.’ Finally, the 
correlations hotweam ratings and tost scores wore about zero. 
The data suggest that the rulings reflect other factors than the 
adcfiuacy of the lilms as leaching devices. 

IMPLICATIONS 

First, tho evidence suggests that training sessions devoted to 
films may last as long us an hour with the expectation that sus- 
taincil Icai’iiing compuiubln to that achieved when several short 
film K(‘Hsions are employed will occur. In mass training programs 
consid(!i'alth! (M'oimmics in scheduling may Ijo realized on this 
basis. 

Second, for eswmtially homogeneous content producers may 
profitably (!Xi)lort5 the relative advantages of making a few long 
films rather than a largo number of single reels. 
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Finally, these results pose an interesting question with respect 
to the limits of massing matcriah It is not unusual for college 
class lectures to last two hours or more. What would tlic conse¬ 
quences be if films were lengthened to that extent, or more? To 
what extent is this apparent lack of difference affected l)y varying 
subject-matter difficulty, the intervals between film scissions, 
and other factors? 
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INTRODUCTION 

RGsenreh in the field of musical talent and its relation to 
achievoment in music study has revealed that the factors which 
oontriliuto to or determine success are at the same time both 
complex and manifold. Musical talent, because of its com¬ 
plexity, probably cannot bo measured by any one test or scale. 

Tills study is primarily concerned with tlie initial guidance of 
prospective instrumental students, and it proposes to suggest on© 
solution to the problem by improving the selection of such pupils 
through tlio use of a broad profile of physiological, mental, and 
other psychometric measurements. 

One of the objectives of the study is to open the area of adap¬ 
tion or clinic classes ns a means of selecting instrumental pupils 
for further study. A second objective is to further study the 
value of the tonclto and a measure of persistence in such selection 
of pupils. 

The prolilcm was to ascertain the prognostic value of selected 
monsurcs of musical aptitude, intolUgenco, persistence, and 
achievement in tonette class and adaption classes as revealed by 
tt special technique, in guiding fourth-grudo pupils into instru¬ 
mental classes. 


SUMMARY OF TUB LITERATURE 

The literature which denis directly with the several relation¬ 
ships encompassed by this study may he summarized as follows: 

1) The median of six correlntionB reported between the Sca- 
slmro tests and success in inatiumcntnl and vocal performance 
was .376. 
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2) The Tonal Memory Teat of the Seashore tostH correlated 
.24 with success on woodwind instmiflcnts, .28 witii huccohs on 
string mstnimcnts, and .45 with Rucce»H on Ijrass insirumonls. 

3) The median of eight corrclationH reported iiclwenn various 
measures of intclligonco and nuiHlcdl tti!lii(!V(‘uu*nt wns .38. 
These correlations ranged from .20 (o .50. 

4) Three correlations \viti» a me<lian of .21 were reported 
between tho SoJtaliore tests and moiusui-os of intelligence. 

5) The median of five cocnicionls of ronlingency, ranging fr(nn 
.37 to .47, between persistence and musical ncluevcmciit was .30. 
One corrolation of .08 ))etwcen persistence ami musical acliiovo- 
ment was reported. 

6 ) Physical measurements of finger length for players <4 the 
cornet, clarinet, and violin correluLcd with auc^'css on these' instni- 
mentb from —.13 to .38 with n median of .15. (?on<‘lalionH 
between aucccss on the cornel mid clarinet and im'asinvjH of teeth 
evenness were ~ .01 and .13, rcspccUvely. 

7) Tho adaption clas.s and clinic cIuhs is recoinnumdcd l>y 
writers in tho field of music education. 

8 ) Correlations were reported for one battery of tests, incliuling 
the Scashoro tests and mcftsures of inlclligence. Tin* eoi'ri'lulions 
were .68 between tho battery and sacceas on tin* cornet, .42 
between tho battery and success on U\c ciariuel, and .31) \>ctwcon 
the battery and success on the violin. 

MATERIALS AND PROCEDUUKS 

The special technique of the study was the organization of tho 
program of testing and instruction as an exploratory eour.se. 
Selected fourth-grade classes were given the Pitcli, Touid Mem¬ 
ory, and Uhytlim tests of tho Hcvised Seashore TohIh of Musical 
Talent, and the California Elementary Intclligenco lc.*<t, Short 
Form, for grades IV to VIII, and each pupil was ranked on the 
Manor Persistence Ranking Scale. During Llie eighUwook jmriod 
devoted partly to testing, tho pupils in these fourth-grade classes 
received instruction on tho tonette. At the end of a piu'iod of 
eight half-hour periods of instniclion on the tonntto (one a week) 
the pupils were given a sight reading tost. All pujiils in (‘uoh 
room then received mslruclion on the violin, clarinet, cornet, 
trombone, and drum. Score caids wore designed in an attempt 
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to objectify the teachor’a iudgmout os to which iuBtrumetvt the 
pupil migiit bogiii to study with an initial advantage. 

After this adaption class, those pupils who wore able to pur- 
chasG an instrument, or for whom the school could furnish one, 
entered the instiumental class. The instrumental class covered 
a period of fourteen weeks, or fourteen lessons at the rate of one 
lesson per week. A final achievement test consisting of a repeti¬ 
tion of tho tonetto test played on the instrument studied, a 
second score on tho adaption 8001*0 card for the instrument stud¬ 
ied, n sight reading test on the practice test, and, after practice 
for one week, another score on the practice test wore given to each 
instrumental pupil. 

The reliability of tlie pcmistcnce ranking was established by 
correlating two rankings of a class of pupils by each of four 
teachers. The re-rank cocfFicicntB ranged from .72 to 1.00, with 
a median of .94. Tho validity of tho poreistenco ranking was 
determined by correlation with an accomplishment quotient. 
Tlio correlations for four accomplishment quotients obtained in 
four sulijeet-mattGi' areas ranged from .32 to .69, with a median of 
.46. 

The reliability of the tonette test was determined by the split- 
half method. The split-halt reliability coofTicient was found to 
be. 88, and, by using the Spearman-Brown, formula, the reliability 
of tho wliolc test was found to be .94. 

Tho adaption class score cards were designed and submitted to 
authorities in tho field of instmincntal music education for 
approval. Final revisions wera made and used on a demonstra¬ 
tion cla.ss by five graduate students. The agreement in score 
rank was close, seldom varying over two or three points, except 
for the violin scores which had been given first. In tho opinion 
of tho five graduate students, close agreement in violin scores 
would have vosiillcd if the violin score card had followed one of 
the other tests. 

Tho adaption score cards provided opportunity to award points 
for tone production, range, lingering, physical execution, tone 
quality, and interest in that insti-ument. The number of suq- 
ccssful trials and performance that matched described levels were 
used to obtain differences in score points. 

Tlie practice or sight reading test of the final achievement tests 
was given to thirteen elementary-school, nineteen junior high 
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school, eighteen senior high school, and ten college instrumental 
pupils as a sight reading test. The average cliffercnliution in 
Booro for the violin, clarinet, cornet, troinliOJio, and drum fccHts 
between the four levels of instniincnlal pupils was six score 
points or an additional six measures played eorrecLly by each 
higher performance ability gi-oup of instniimMUiil ijupils. 

The musical maloriul included in Mio final test was selected 
from the inatriiclion hooks used in the inslrviinental elasa nnd 
presented increasingly diflicultperforinnneouEul musical problems. 

Ail tests wore cither mimeographed in bhurk on wliitc or l>luc- 
printed. Copies of each test, with inatruclions for admiidstering 
and scoring with class record blankH, were included in u. manual 
of instructions for each teacher. All tests were sent to the direc¬ 
tor of the study for roscoring, and a list of llie scc»res was returned 
to the teacher. 

The original sample included twenty-four tdassos of fourth- 
grade pupils from Evansville, Jasper, Huntington, and lilooining- 
ton, Indiana, and Champaign, Illinois. Eight elaKsn.s, consisting 
of two hundred seventy-three pupils, wore unultlo to f!om])lo-lo 
the exploratory program and were discarded or dropped from tlui 
study. Of the sixteen remaining classes, wven, consisting of (me 
hundred eighty-four pupils, wore not able to complete Die instru¬ 
mental class or did not have any pupils in it. Nine, cou.sisting of 
two hundred nineteen pupils, contributed lifty-eiglil instru¬ 
mental pupils to the study. 

FINOriiOB AND CONCLUSIONS 

Organization of the Program .—Comment vipou the ovgaivizatiou 
of the program by the teachers participating in the cx])ci’iinent 
was a part of the data to be obtained from the study. The com¬ 
ment as summarized below should bo of value to future attempts 
to organize such a program. 

1) Allof the ten teachersparlieipaling in the program oxprewsed 
a desire or need for an organized program of instrumental guid¬ 
ance. Most of these tcachoi's had hern searching for or de.siguing 
such a program for their own schools. 

2) Only the two teachers who taught in one R<'.Uool wore able to 
complete the entire program during the year as scheduled in tho 
manual of instructions. Tlio teachers in the Evansville schools, 
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with one exception, taught in two or more Bchools but used only 
one class each in the experiment. 

3) The program or schedule of the teachers assigned to more 
than one school was so inflexible that if periods were missed they 
could not 1)0 made up. Individual pupils missing tests were not 
able to meet willi the teacher at spocial times to take the tests 
missed. 

4) Several of the schools hod scheduled the program for 
Friday and found that many Fridays were missed in their school. 
Tlicso teachers would recommend that a one-period-a-week class 
be scheduled sometime during the middle of the week. 

6 ) All of the teachers who were able to present at least one of 
the adaption classes commented upon the fact that interest in 
participation in instrumental music was greater among the pupils 
after these pupils had taken part in the adaption class. 

0) The three teachers completing the adaption classes for their 
scliool.4 seoincd to feel that about eighty per cent of the pupils 
entering the instrumental class had chosen the instrument that 
the teacher would liave Koleclcd for that pupil. The balance of 
instruments, except for the violin, scorned to be satisfactory for 
each school with planned changes from cornet to French horn at 
a later dale. 

7) ^omc schools plan to use the program, somewhat modified, 
as a year program in the fourth grade, starling all instrumental 
pupils in ilio lifth grade. 

8 ) Any exploratory program, such as the one used in this study, 
apparently sliould l)c organized in terms of the needs and facilities 
of the soliool using it. 

Jidatioiiships for the Whole Group. The relationships found 
between tlic various guidance measures for the whole group are 
probably a closer approximation to the true relationships between 
these fuclois than tlie relationships found with only the instru¬ 
mental group becuuBP of a much Bmallcr number of cases and the 
possible bias in the instriiincnlal group scores duo to factors of 
Bolcclif)!) operating. The following points arc indicated by a 
study of the data for tim wiiolo group i 

]) 'I’lio diH(!ardc(I classes varied significantly on tlio basis of an 
analysis of variance of the non-language inLcIligonce scores. A 
value for F of (>02.3 was found for the variance in these scores. A 
value for F of 6.70 would be exceeded by only one per cent of all 
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similar random samples. Consequently the observed value of 
002.3 indicates a highly significant variance. 

2) A comparison of the discarded and retained groups of pupils 
on their previous training in inalrumcnlal music reveals that 
thirty-six per cent of the retained group and only five per cent of 
the dvficardecl group had previous Iraiuiug. 

3) Tho retained and discarded gn)up8 were compared on the 
basis of their rcapoctivo score dislrilnitioiis on llu* tont'lt<‘, violin, 
Seashore Pitch, and total intelligence tests. The ehi-flfiuare teat 


Tajjlb I.—The Cni-SQUAitET krt Apuued to the TotalInthl- 
LiGENCB Scores op tub Discarded and Hetained Huoupa 


Inter¬ 

Ee- 

Dis¬ 

Per 1 

0 — i (o — 0’ 

(o - 0“ 

val 

tained 

carded 

cent 


'l 

Code 

Group 

Group 

1 



8 

1 

1 

.00 



7 

24 

3 

22.44 



0 

67 

10 

37.02 00.72 

—10.7 1050.40 

27.20 

5 

110 

56 

72.00 72.00 

-17.0 309.70 

4.20 

4 

49 

09 

32.34 63.30 

27.0 701.70 

J2.01 

3 

90 

91 

03.30 32.34 

30.7 1340.HO 

41.70 

2 

17 

13 

11.22 11.22 

1.8 3.24 

.30 

1 

1 

8 

.60 25.08 

-10.1 250.21 

10.32 

0 

37 

1 

24.42 



Total 

392 

2B7 



>= 95.88 

was used and i 

aignificant values for chi-squaTo ai)Ovo the ono per 


cent level of probability of occurrence by chance wore found for 
all but tho tonotte scores. Tho value of chi-Rijuaro found for tho 
difference between the two tonette score distributions would bo 
exceeded by not less than ono per cent and not more than five per 
cent of all random samples. 

Table I shows tho chi-squaro test applied to tho total inttilli- 
genco scores of the discarded and rclnincd groiips. Prom a laiilo 
for P for five degrees of freedom a value of 15.080 would lio 
exceeded by only one per coat of all random samples. Tho 
obtained value of 96.88 in Table I is higlily Bignificaul and tlio 
difference between tho total intelligence scores of llio discarded 
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and retained groups are larger than could be attributed to chance. 
In view of the significant difTei'cncea observed between the dis¬ 
carded and retained groups, we must assume that different results 
might have been observed for the study if it had been possible to 
retain these pupils. 

4) Because of the similarity between the tonette class and the 
instrumental class in the manner in which both are taught and 
measured, the tonette scores of the retained classes were used to 
analyze the variance between tho sixteen rooms comprising tho 
retained group. It was found that tho differences between ten 
classes taught by the same teacher were significant although tho 
differences between two classes in the same school from that 
group were not significant. Tho differences between six classes 

Tablii II.— Tub Variance betaveen Ten Classes Taught by 
One TEACiiEn and Six Classes Taught dy Six 
Different TEACUEns 



d.f. 

s.s. 

Variance 

Between six classes 

5 

1807.41, 

361.48 

Between ton classes 

g 

1984.05 

220.46 

Total 

14 

3791.46 

F = 1.19 


taught by different tcaohera wero also significant. Tho differ¬ 
ences between the sixteen classes of the retained group were also 
significant. However, when the differences between the ten 
classes tauglil by one teacher and the six classes taught by differ¬ 
ent toachcra wore analyzed, it was found that the differences 
were not significant. 

Table II shows the variance between ten classes taught by one 
teacher and six taught by six different teachers. From a table 
of F for nine and live degrees of freedom, we find an F of 4.78 
would be exceeded in five per cent of nil samples of this size and 
an F of 10.15 would bo exceeded in one per cent of all samples of 
this size. Tho obtained F of 1.19 indicates that tho teacher 
variable l)otwoon these two groups of classes is insignificant. 

It is rea.sonal)lo to assume that since the other classes have been 
taught in a similar manner, the teacher variable for the rest of the 
experiment might have been of no particular significance. 
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5 ) An examination of tho comlatiouH in Tallin III reveals that 
the three measures of intelligence show aiioul tlie same relation to 
the other measures in the study. The correlatioim Ijntwecni noii- 
languago intelligence niid the otlier Inn factoi-a ranged from -.01 
to .33 with a median of .13. The r.orrdalionH between language 
intolligonco and the other factors ranged from —.01 to .'K) with a 
median of .10. The corrclitUons hotween loliil intnlligeiicis and 
the other factors ranged from .00 to ,43 with a nuMlijin of .10. 
The correlations l)clwcen non-langnagOj language, and total 
intehigenco and persisloncc were .33, .40, and .43, respectively, 
indicating the possibility that intelligent, as well as pereistent, 
behavior has influenced the persistence ranking. 

C) The Seashore IMteli, Tonal Memory, uud Rhythm IchIh cor¬ 
related .33, .41, and .33, respectively, with the violin adaption 
clasB score. The corvelatiouB betw’ccu the three Seashore tests 
and tlio other adaption scores ranged from —.12 to .18 with a 
median of .07. The Rhythm test showed corr(4alions of .30, .02, 
.62, and .40 with the first four subtests of the drum adaption class 
test. The Rhythm test scores correlated .02 with the lonctlo 
test scores, which indicated a considerably closer relation than 
either the Pitch or Tonal Memory leslH showoil. The cor¬ 
relations between tho Pitch and Tonal Memory test scores and 
the tonette test scores wein .17 and .15, respectively. 

7) Tho inlercorrelationa between the three Seasliore te.sts miglit 
indicate some overlap in the capacities im'asnred hy cacli t('.sL. 
The correlation between tho Pitch and Tomil Minnory li'Hts was 
.60, and between tho Pitch and Rhythm lusts it was .37. Tho 
correlation between tho Tonal Memory test and the llhyllun t(?Ht 
was .37. 

8 ) The best factor for predicting toncltc success was tho per¬ 
sistence ranking, with a correlation of .GO. The tonette scrore.s 
appear to be more closely related to tho violin and dvvim i\da\>lion 
scores, as indicated by cori-claiions of .39 and .27, i(:.sp(!ctiv(4y, 
than to tho clarinet, cornet, and trombone scores as shown by 
correlations of .15, .05, and .05, respectively. 

9) Tho iutorcorrolations between tho adaption class seoi'es 
range from .01 between tho violin and cUu’ino.t Rcorou to .01 
between tho cornet and trombono scores. Tho median intcr- 
correlation of ton coelKcienls was .24. 

10 ) The obtained correlation of —.77 between success on tho 
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Table III. —Intercoruelationb op the PnBDtcTivB Factors 


Mens- Ton. Rliy- Per- Ton- Vio- CJar- Cor- Trom- 


urea Pitch 

Mom. 

thm 

slat. 

otto 

lin 

inct 

net bone Drum 

C.A.* -.10 

-.10 

-.03 

-.18 

-.13 

-.13 

-.01 

.07 

.01 

-.04 

n 300 

300 

300 

342 

342 

185 

247 

260 

266 

86 

Non-I«. . 15 

.22 

.11 

.33 

.28 

.18 

.05 

.08 

,11 

-.01 

n 300 

300 

300 

342 

342 

185 

247 

200 

206 

85 

Lang. .18 

.23 

.00 

.40 

.37 

.12 

-.04 

-.01 

.00 

-,01 

n 300 

300 

300 

312 

342 

185 

247 

260 

266 

85 

Tot. IQ .21 

,27 

.11 

.43 

.38 

.26 

,00 

.02 

.05 

.00 

n 300 

300 

300 

342 

342 

185 

247 

286 

266 

85 

Pitch 

.00 

.37 

.11 

.17 

.33 

.00 

-.04 

.14 

.14 

n 

820 

329 

320 

320 

141 

253 

294 

204 

85 

Ton. Mem. 


.37 

.12 

.15 

.41 

.00 

.00 

.16 

.08 

n 


329 

320 

320 

141 

253 

294 

204 

85 

Rliythm 



.69 

.62 

.33 

.00 

-.12 

.14 

.18 

n 



320 

320 

141 

253 

204 

204 

85 

PorsisL. 




.00 

.22 

.10 

.02 

.08 

.22 

n 




185 

188 

255 

20D 

299 

85 

Tonctlo 





.39 

.16 

.06 

.05 

.27 

n 





185 

255 

200 

299 

86 

Violin 






.01 

.02 

.23 

.40 

n 






112 

112 

112 

85 

Clarinet 







.20 

.26 

.35 

n 







258 

258 

86 

Cornet 








.01 

,16 

n 








315 

85 

Tromhono 









.40 

n 









85 


* CA in clironnloKififtl Non-I^. is noii-lanp;unRn IQ; Lang, is language 
IQ: and '[’ot. Ki is the eoiiiljiiied IQ; Ton. Mem, is tlio Tontil Memory Test 
ol Iho ScuHhove tesls; nml PersiBt. ifi the Pcrsislonco ranking. 
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tonotte and previoufl experience in months is not consistent with 
the experience o( the tcftcUcrs participating in the study. Experi¬ 
ence in months docs not indicate the value of tlic experience in 
terms of skills, musical knowledge, and nbiUly, and it is tliu 
opinion of tlieso teachers that the information rather tlian tlie 
relationship is at fault. 

11 ) On tho baHis of tiie experience of tlie teachers paiiiftipating 
in the study we must conclude Unit the Humo program cannot 1)0 
administered oqvially well in every seiiool. Any program 
designed for guidance purposes in instniinonlal inuHio will likoly 
have to be modifiicd in ierma of the school which it iniml serve. 
All of tho teachers participating in the study liavo oxpressed tho 
need for such a program and indicated that tho adaption classes, 
where used, Btimulatcd interest in instnnnontal inunic. 

CorTclaliona between f7^r/aw Factors Reported.—-Tho relation¬ 
ships found for the instnnnontal group aro in close accord with 
the findings of previous investigatora, with tlie excoption of Die 
relationship observed between intclligonco and iiiHlrumcnlal 
achievement. The median of eight corroluliona reported between 
intelligence and musical achievement was .38, llio median found 
in this study was ,09. The median of six corrolutions IjcLwo.on 
the Soashoro testa and instrumcnlai and voice achievement was 
,SS, and in this study tho median found was .7>2. T'lic median nf 
three correlations reported between the Siicashore Tonal Memory 
test and instrumental aebiovemont was .24, and for Lliis study the 
raodian waa .32. Tho median of aix concIalioiiH reported 
between pcreiatenco and musical achicvcmenl waa .-lO, and for 
this study the median was .30 with instrumental achievement and 
.44 with tonetto achievement, Tho rclationsliip found hotwcon 
the Seashore tests and mtolUgenefi in this study was .23, a 
median of three correlations, and the reported relation in the 
literature was .24, a median of three eorrelations. 

Apparently there is a close agreement between the findings of 
this study and previously reported studies for tlicso relatioriHhlp.s. 

Concernino the instrumental fifrowp. Tho following (•ouo.luHious 
were reached concerning the relationships found betwoon tho 
achievement of the fifty-eight mstramenlul pupils and tho guid¬ 
ance measures. 

1 ) The correlations found between the non-language, lan¬ 
guage, and total intelligence measures ond ochicvcmcnt of .17, 



Table H*.—Lctehcorkelations between the Yaeious Gthbance Measures and Cokhelations be¬ 
tween TEE Guidance Measures and the Achievement Tests 
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.06, and .09, respectively, would have justirted dropping those 
measures ol intelligence but leaving the \vholc question of intcb 
Ugenco test measvircs open for further mvestigation. 

2) Of the three Seashore tesla, the Pilch Teat allowed the 
closer relation to the achievement scorea, a correlalion of .49, 
also the highest correlation found between the guiduiKfc mensurea 
and achiovoinent. Tlie 'L'onul Memory loai of llui older Seaslioro 
tests usually produced llie higher correlation between the Hou- 
shoTc tests and measures of achievement. Tlie correlation found 
between the achievement acorcs and llic Tonal I^Icniory tost in 
this study was .32, and a correlation of .21 was found for the 
Rhythm test, as shown in Table IV. 

3) The persistence ranWng was pignificantly related to pu})il 
success on boili the lonetlc and an instrument. The correlation 
between the persistence ranking and iualrumonlal nrhievemenl 
scores \\’a3 .30 and hotween pcraistonce and tonclte succciw it 
was .44. 

4) vSuGcesa on the tonetto produced Iho bccoiuI liighest correla¬ 
tion witli inatrumontal achievement, an r of .41. This rchUion- 
ship would indicate that 8 UCCRS.*i on tho loiK'Lle is as valid a 
guidance measure as tho Seashom IchIh for guiding pro.Hpcelivn 
instrumental pupils. 

6 ) Previous training and the adaption clas.s Hcorcs woro of 
about equal value in predicting Instrumental hiu^cc.-^h iih is indi¬ 
cated by their respective correlations with aclnovcimuil of .29 and 
,27. Previous eliminalion and eelf-guidanco, bawd soinuwlial 
upon the adaption class scores, may have pliutcd loo great a 
burden upon the adaption measures in expecting them to clis- 
tinguish between success levels. It might well be that with a 
refinement of the measurements in the adaption clas-s scores, such 
diaorimination would bo poasiblo. 

As the quartilo disposition of achievement scores given in Talilc 
V would seem to indicate, the adaption chi-ss scores were about as 
effective in selecting the highest and lowe.st cpuirliloB of aidiioverH 
as the other guidance moftsums. It wils fouiul that fifty per (unit 
of tho first quartilo of the achievement scores w(Ud drawn from 
tho first quartilo of the adaption class scores and that forty-throe 
per cent of the fourth quartilo of the achiovoinent sooro.s were 
drawn from tho fourth qiiarlllG of tho adaption class Hcorcs. Tlie 
Seashore Pitch lest showed that fifty-soven per cent of the first 
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quartile and forty-three per cent of the fourtli qunrlilc of uehieve- 
ment scores were drawn from the first and fourtli ({uartilos, 
respectively, of the Pilch scores. Tlic Tonal Memory test of 
the Seashore teats showed the Bnme per cent from the first and 
fourth quarliles as the adaption scores. Tlie other guiduneo 
measures showed smaller porccnlngeH at one or both cxtHuncH 
than the adaption class HCorc.s. 

0) The smaUer luimhor of cases in Iho qiuirlilo diHlrilmliona tor 
the three tcaciicrs would make a direct eompurison of tlie effcc- 
Livenoss of the mcasure.'s for each leachcr inconchisive. The 
qiini’tiles contained from four to six pupila’ scores and the change 
of one score would chango the imst cent from BovonUien to twenty- 
five points in each inatancc. The per cent found for the three 
teachers was averaged and compared with the iier ecuL in each 
quartilo found for the group as a whole. Tlic dilTerpuco was 
usually within from five to ten. per cent, indicating the possibility 
of some consistency in the operation of tlic.He nicaaurc.s in the 
experiment. 

7) Although the mcoaurcs might be heli)ful in a guidance pro¬ 
gram, rigid dilToi'ontial individual guidance cannot ho juatified 
on the basis of the results found in Uiih atudy. 

lUSCOMMliNPATIONS FOR TllM XJSK OF TllR WrOUY 

None of the obtained correlations were Bufiiclcnlly higli that 
rigid differential individual guidance could be juslilicd. How¬ 
ever, the following points seem indicated from a review of tlio 
experiment. 

1) The correlations between the non-language, language, and 
total intelligence scores and achievement were .17, .(15, and .01), 
respectively. Those msults would seem to indicalo that the 
intelligence measures might well bo omitted from lUe testing 
program. 

2) The correlations found between the Pitch, Tonal Memory, 
and Rhythm tests of the Seashore battery which were .40, .32, aiul 
.21, respectively, would indicate that, although individual guid¬ 
ance on iho basis of those measurGs would not lx; juHtified, they 
may bo helpful in pointing out pupils for consideration who might 
otherwise bo overlooked. 

3) The correlation of .30 found between perHisteneo and 
achievoment and of .41 between the fconotfce scores and achieve¬ 
ment would indicate that both of these measures might bo of 
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some aid to the teacher. The pupil-teacher association in the 
tonette class gives the teacher an opportunity to know bettor the 
pupils with whom he is working in addition to the guidance 
value of tlie fcoiiolto class. 

4) The adaption Bcore cards were not able to differentiate 
clearly between those pupils who were among the middle success 
scores. However, since pi-climinary diffcrcntiatioii had been 
made in many cases by the operation of the adaption class, the 
adaption measures may bo more effective than the roaults show. 
It is reasonable to assume that the initial differentiation would be 
more important to both pupil and teacher than the final differ¬ 
ence in aiiccess levels. 

6) The three instrumental teachers would have had about a 
50”50 chance of predicting the upper and lower quartiles of 
achievement scores from the upper and lower quartiles of the pre¬ 
dictive measures. Slightly better than chance predictions of the 
upper and lower halves of the achievement scores could have 
been made. Considerable caution must be exorcised in the tise 
of these monsuros for guidance purposes, and possibly othors 
suhslitulcd. 

IIKCOMMI5NDBD cnANOKfl OR MOPinCATlONS 

Each of the changes proposed in the present study will be 
explained ns tlicy arc presented. 

1) The three intelligence mcusurcH might be dropped from the 
testing program. This woukl seem to be indicated by the corre¬ 
lations found in this study between these measures and achieve¬ 
ment. The correlations ranged from .05 to .17, 

2) The Seashore Rhythm test might he dropped from the test¬ 
ing program also. The correlations found between the Seashore 
Rhythm lest and the siibtcsts of the drum adaption class test, 
which range from .30 to .02, indicate considerable relationship. 
Sineo the drum adaption class serves at least one other function, 
that of introckuiing the pupil to the dram itself, and, the drum 
scoro.9 and tlui Rliylhm test seem about equally related to 
aohioveinont as ijuUealod by corrclationa of .27 and .21, respec¬ 
tively, it is recommended that the dr\im adaption class tost 
servo as Iho rlvythm mcasui’c of the testing program. 

3) It is recommended that the music teacher rank the pupils 
during the tonette class at least once, and preferably twice, in 
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addition to tlio room teacher's ranking. The average of those 
tlirce rankings might prove a bettor estimate of the persistence of 
the pupil. 

4) The tonetlo test given at the end of the tonette instruction 
was a sight reading tost. This measure should bo broadened to 
give a bettor measure of the musical knowledge gained. The teat 
iniglit include a written test on the knowledge of mimical sym- 
hola uaed in the instruotional malcrinl. Sonui creiiit might l )0 
given for the ability to play a memorized melody correctly 
although the pupil cannot read the notation for that melody, 
Some measure of the facility with whiclr the tonette is played and 
tho control exercised upon the tonette should be included in the 
test. 

5) It is recommended that wherever possildc, the lengtii of 
time spent upon each instrument in llie adaption classes ))e 
increased. The limit of diminishing returns cajmot l)e set from 
this investigation, but from teneher cojnmcnt it is recommended 
that the class bo extended until the teacher is rensunably certain 
that each individual pupil has ceased making marked Improve¬ 
ment over the previous day’s offorls. 

6) A performance test combined with a wrilltm lest might 
prove to bo a better measure of previous musical cxtjericnco than 
merely the length of lime n pupil has played an instrument. 

7) The intercorrelations between tlic various parts of the 
achievement test would indicate that all of tiiose parts migiil 1)0 
retained. The correlations range from .13 to .40. 

ADDITIONAL RBSEABCn fiUGGESTKD 

One of the objectives of this study was to open the area of the 
clinic or adaption class for further investigation. Some of tho 
problems that seem to need further study are prc.scnted, with 
suggestions that might prove helpful in suck iiivestigutious. 

1) Tho tests that make up the score cards for tlie several instru- 
meuta may not be the beat group of testa for that inslvumoul. 
There is a need for a larger sampling of tests for each instrument 
also. From a largo sample of tests for one of the hcoi'c cards, a 
better group of teats for guidance purposes might bo selected. 
■Uaing the violin acoi’c card as an example, an outline of an investi¬ 
gation is given hero. 
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Each phaao of violin tcchniquo covered in the violin score card 
could bo expanded. Tlie bowing skills might include six pat- 
torna instead of one pattern. This might bo whole bow, half 
bow, whole bow followed by two bows in tho upper half of the 
bow and the reverse, broken bows in the quarter and eighth note 
pattern of 0/8 time, plus additional string crossing exoi'cises. 
The fingering exorcises might be repealed on the A and G strings. 
Pictures might serve to dcmonslraie position as well as verbal 
description, and recordings might aid in establishing an aural 
picture of tone quality for comparison. 

From repealed testings during instructional classes for the 
violin, an analysis of the improvement for the several test could 
bo made which would indicate the tests which differentiate 
between tho high and low total scores consistently and the weight 
in the total score to be assigned to each test. The minimum 
duration of tlie adaption class which would still provide differen¬ 
tial measurement might be ascertained. This type of investiga¬ 
tion might be made for each of tho score cards. 

Tho small numl)or of pupils available for each type of instru¬ 
ment in Ihis BlLidy prevented an analysis of the elTcctiveness of 
each seoi’o iiulcpendontly. If one class having over tliirty-five 
pupils could be used, for example, in which all of the pupils would 
play ono instrument, a closer approximation of the guidance 
value of the'score card could be obtained. 

2) ICxpcrimontal data on the value of the tonette for purposes 
of instrumental guidance is practically non-existent. The rela¬ 
tionship found Ijclween success on the tonette and achievement 
ill in.strunKUital music would seem to juslify further investigation. 
The test for tonette achievement could include a broad measure 
of skills and ability that might point to the optimum period of 
instruction for guidance purposes. The number of zero scores 
found for many pupils in this study might indicate that the period 
of instruction was not long enough to obtain iiii adequate measure 
upon the inipils who apparently could nob loam to sight road the 
material ]’oquij*G(l in tho lest. 

3) Further invostigation of the Revised Seashore Tests of 
Musical Tali'll L may reveal (liflorcnt relationships tlian those 
gonorally found for tho older lo.sts. The Pilch lost seemed to 
allow closer relation to achievement in this study, whereas the 
Tonal Memory tost of the older measures usually correlated 
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more highly witli measures of achievoment tlian the rest of the 
tests. 

4) The conflict in scliedulo between special classes that meet 
once OT twice a week and Bpecial events such as convocations, 
vacations, teachers’ meetings, etc., suggest that the problem 
might be investigated in order that these special c1uhs(;s miglit bo 
scheduled at a time when fewer conflicts would e.vist. 

6) The problem of evaluating musical experience on an instru¬ 
ment for gv\idance purposes may be closely related to the problem 
of the guidance value of tonette experience. Some measure of 
performance, of ability to read music notation, of attitudes, and 
musical perception probably should be included along with the 
rate of development of llio pupil before evaluation is made. A 
scries of ease studies might disclose the tecbnitiuc tliat would ena¬ 
ble evaluations of larger groups of pupils to be made adequately. 

It ia hoped that other problems in addition to the ones outlined 
above will suggest themselves. It is realized that llio i)rc8cnt 
study is only a beginning and that, before the value of the new 
measures used in this study and of other possible ineasurcs not 
employed by us can be ascertained, additional studies ^YiU have to 
bo made. The dcartli of research in tlic field of the toneUo and 
adaption class must bo remedied before certain forward progress 
in instrumental guidance can take place. 
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THE RELATIONSHIP OF READING AND SPEECH 
DIFFICULTIES 


THOMAS H. EAMES 
School of Education, Boston University 

Thcvc is an analomical as well as a physiological or psychologi¬ 
cal relationship between speech and reading. Both are language 
lunations, ooraraouly located on the left side of the brain; the 
latter being centered in the angular gyrus (Brodmann area 39) 
and the former in the inferior frontal gyrus (Broca's area or 
Brodmann 44) together with parts of areas 4 and 6 in the pre¬ 
central gyrus where the control of the muscles of speech are 
locatocl. All of those, in common with the other centers in the 
language area are closely interconnected by association paths and 
with the less well localized psychic centers. The association 
paths between the speech and reading centers are of particular 
importance in oral reading, juat as those between the speech and 
auditory areas (41 and 42 and probably part of 22 and 37) are 
significant in their relationship to the formation of speech 
through association of the sounds of words with the muscular 
movements required to produce them. 

Defect.^, doficioncies, trauma or pathological processes in the 
various centers Lliem.solvcs give rise to well-known aphasias, both 
partial and complete, bub inlcrfm’encG with the association tracts 
between the centers may impede or block certain aspects of 
learning, It is well Icnown, for example, that trouble in the 
auditory area may impair the ability to learn speech sounds and 
thereby interfere with their reproduction by the pupil. Diffi¬ 
culties in the pathways connecting the visual, auditory, and 
reading areas may interfere with the transmission of adequate 
stimulus impulses from one to another and impair the association 
of visual and auditory symbols. Similarly impairment of the 
association pathways between these centers and the spooch area 
is likely to interfere ^vith visual and auditory associations with 
speech. 

The literature cxlubit.s a growing interest in the relationship 
between Bpoceh and reading dilliculties. Bennett‘ stated that 

children presenting ajTlBtoiT-'' '"V-.t:.- 

reading failure, while |fcKlillloA* '■ > . ■ 
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reading cases were found to exhibit marked defects of speech. 
Eamea* reported fwo per cent more speech defects among reading 
faiiurea than among non-failures. On the other luvud Moorc^ 
Btudiod a group of high-school pupils and found only a few cases 
of deficient reading among those cxlu!)itmg ttpcccli hundicapH. 
A. aroall positive correlation between spcceli ago and reading age 
was reported by Davis,® wliile Bond* found no difToroiicoH in tlio 
incidence of speech defectiveness among either good or poor 
readers. 

Quite a number of investigators, like Gaines,’ have pointed out 
probable relationships between dcncleiicica in rca<]ing and spcecli. 
For example, in studying first- and second-grade pupils, llos- 
signol* found that reading performance varied Higniiieanlly with 
speech production. Generally, however, lliey ai)pt‘ai' to ))oli(5vo 
that factors which affect speech may also interfere ^Yith roajling. 
Kobinson® stated that dyslalia was the comnionest cause of read¬ 
ing failure, and stuttering not at all so among thirty cases in her 
comprehensive study. She concluded that inudeejuate uudittiry 
memory span for sounds and insunicicnt auditory discrimination 
might be causes of both reading failure and speech diflicullies in 
some cases. Monroe'*^ made a similarly cautious dcdnclion in 
one of her studies, indicating that speech dillicully might 1)0 a 
cause of reading failure or that both speech and reading troubhjs 
might arise from a common cause. Moser** explained Rtuttoring 
as being duo to a neuromuscular derangement which miglit also 
account for diffioully in reading. The frctiucnt co-exirttonce of 
' speech defects and poor eye muscle control was pointed out by 
this investigator, Witty & ICopeB* fell that emotional rcacjlioiis 
to defective speech might contribute to reading and language 
failures, while Cobb*® considered uncertain dominance an impor¬ 
tant cause of both reading and speech defects, although he did 
not regard strong Icfte-handcdness as being so. Bond,** Hil¬ 
dreth,*® Monroe,** Robinson,*’ and Schonell*" wore in Homo aKi’oo- 
ment in giving considorablo attention to weakness in midilory 
discrimination as a cause of both defective reading and d(!f(’(!live 
speech. Davis*® studied the relationsliip of oral invading to 
speech and came to the rather obvious conclusion that a oluld 
who articulates well is likely to road faster and more accurately 
than one who continues to use baby talk. Hall®® gave attention 
to speech and silent reading, coming to the conclusion that there 
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is no relationship between these functions. Of course, one would 
expect less relationship between speech and silent reading than 
bclwcon speech and oral reading. The anatomical connections 
in the brain support this. Travis®* found stutterers retarded in 
the rate and comprehension of silent reading as well as oral, and 
^ioodstein,-® investigating the reading rates of stutterers in the 
non-stuttering, fluent interval, found that stutterers read more 
slowly than non-stulfcerers in this period. This showed that, 
even wlion not atuttering, the stutterer is impeded in his reading 
by his language handicap. 

Treatment of speech defective childi'on continues to involve 
reading in some of its techniques. Choral reading is often 
employed to help remove a, stiittercr'a emotional tension and to 
provide model speech which he hears and follows. Pattie and 
Knight^® expevimonted with twelve subjects, having them read 
in six dilToi'ont situations. Their conclusion was that the 
removal of emotional tension is not a veiy important factor in the 
impvov(iment of oral reading among stutterers during choral 
reading. However, they offered no definite evidence that hearing 
others speak facilitates the speech of the stuttering child, Helt- 
man®"* advised choral reading with the stutterer being given solo 
linos. 

Tliei'o is no gcnezul agi'eemcnt about fclie relationship between 
reading and spcceli failures or defectiveness. Probably this is due 
partly to some maturation or learning factor which produces 
different conditions at various age and grade levels. It ia not 
unlikely tlint many of those who invotignic the problem lack the 
breadth of training and experience to bridge the two fields well 
enough to explore their peripheral as well as central relationships.' 
I-Iowevcr, certain broad generalizations can be drawn. 

1) Neurological lesions iu the language centers or their inter- 
connecLions may impair both speech and reading. 

2) Failure or madcquacy of auditory association and dis¬ 
crimination may predispose to either speech or reading trouble. 

3) Speech defects occur in a certain proportion of reading fail¬ 
ures and vice versa. 

4) F.motional reactions to speech difRculLica may impair 
reading. 

6) Oral reading ia more difficult for a person with a speech 
defect. 
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The author's conclueion is that ijoth speech and reading 
troubles are very likely to stem from tlic same basic defect, ns 
may also other language function iinpairmonLs. lCss(*ntially tlio 
problem is neuro-physiological with psychological overtcaioa, but 
the inadequacy of present invesllgativo molliods nuike it noces- 
Bary, at least for praeticnl purposes, to subdivide Urn bold aiul® 
apportion the ndministmtion of IroatineiiL among peraons who 
have made n special study of its various aspects. Tlic weakness 
of this plan lies in the slowness of tlie various component gronp.s 
to follow leads into adjacent language fields, duo in large part lo 
limitations imposed by economic, cducalional and demand fac¬ 
tors, The strength of the plan lies in the imnicdialo practical 
benefit made available to pupils with language difficnltiea by tlio 
person who knows something beneficial to do regardless of 
whether or nob it is consistent with the optimum over-all under¬ 
standing of language defects and deficiencies. Probably a bettor 
and more unified approach to the treatment of combined lan¬ 
guage difficulties will emerge wdth further rcsoarch. 
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A. NOTE ON THE VALIDITY OE THE MENTAL AGE 

CONCEPT 

IIUKMINI S. IlAMA3ESnAN 
Stnto TJnivcraity of Iowa* 

The question raised hero about tlie validity of the Mental Ago 
is concerned with the generality of this unit of moa«urcineiit. 
For examploj is an MA of 8 earned by Hix-yoar-uld and ten-yoar- 
old children the same MA? An MA score is an average of scores 
made on various types of tests involving a variety of mental 
processes. Since bright and dull childrou of q given MA earn 
the same average score, any differences among the aubscores 
as between these bright and dull children would have to bo 
compensating, 

The purpose of this investigation is lo lest tlie validity of llio 
Mental Age concept by debermining whether (jr not there are 
systematic qualitative differcncoa between hrigiil and d\dl 
children of the same MA's on the subscoves on certain tests. 
The testa used in the proUminaty invesUgation arc Thv. Chiaujo 
Pesls 0 /Primary Menial AbilUics and The Iowa TcMa of P(fuca- 
tionai Development. These particular tests wore aiudyzed for 
the purpose stated above, partly because the scoro.s on approxi¬ 
mately six hundred ninth-grade pupils amro nnulo available to the 
writer, by Dr. D. C. Shaw, In addition, the Primary Menial 
Abililies tests have the merit of having sublosts of pure f(jrm and 
satisfactory reliability. 

The two testa were administered to the entire ninth-grade 
population of two midwestern high schools. The taslc was then 
to select groups of students falling within given menial ago 
categories on the Primary Menial Ahililiea tests and to form sub¬ 
groups of bright (younger) and dull (older) pupils and to comparo 
their scores on the subbests of this battery. Tlie porformanco of 
the aamo subgroups of pupils was also compared on cncli of the 
Bubtosts of the Iowa Tests of Edticalional Development. 

The sampling of six hundred pupils from a single grade, the 
ninth, did not yield an adequate mmdujr of cases of l)vight and 
dull pupils having common MA's. itowever, lUo number 

*ThiB articlo is a partial report on tljo writer’s Master’s Tltouis. Tlio 
work was dono under tho direction o( Profe^r J. B, Strovul, 

66 



57 


Validily of dte Mental Age Concept 

appears to be sufficient to mako the report of the results worth 
while. Had the six hundred tests been administered to pupils 
spread over two or three gradeS; instead of one, more useable 
eases would, of course, have been available. 

The mean MA of the entire sampling was 186 plus months, on 
the Primary Menial Ahililied testa. An MA category of seven 
months, 183.6-189.4, was determined. The pupils in this MA 
group whoso chronological ages fell above 177.7 (the mean CA 
of tlio pupils ill this MA category was 171.7) were placed in the 
older or 'dull* group; those whose CA*s fell below 165,7 were 
placed in the younger or ‘bright* group. Thus the minimum 
diffcroncG in CA between the so-called dull and the bright pupils 
is one year of CA. It will be observed that dull here merely 
moans a lower position in the group. Actually the mean IQ of 
the ‘dull’ group is approximately 100. Two seven month MA 
categories were likewise established above MA 189.4 and two 
below MA 183.5, and bright and dull subgroups similarly formed. 
Altogether these groupings yielded fifty-three bright and thirby- 
fivo dull pupils. The comparative scores of these two groups on 
the respective sub tests of the Primary Mental Ahililies tests are as 
follows: 


Verbal 

Num- Mean- Word Reason-Mem¬ 

ber ing Space Fluency ing ory 
Bright Pupils 198.46 185.64 105.60 176.71 207.07 180.89 
(Mean IQ 115.2) 

Dull Pupils 203.01 174.03 177.30 181.34 191.85 185.91 
(Mean IQ 101.6) 

The menu score of the bright group on all six tests is 185.69; that 
of the dull group 185.61. 

The bright group is aignificantly superior to the dull group on 
Verbal Meaning and llcnsoniug, the diltcrenccs being 5.93 and 
7.21 times, respectively, tlic SE of the dilTerence.s. The dull 
group is significantly superior to the ])r!ght group in space, the 
difference being 3.49 the HE of the difference. On Word Fluency 
a difforonco was obtained of 2,63 times tlio SE of difference 
favoring the dull group. 

The bright group exceeded the performance of the dull group 
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on all tho subtests of tho Iowa Tests of Educalioml Dcvdopmenl. 
The cUfTcrenccs are significant in the case of only three subteata: 

Correctness in Writing (Dif./Sl5dif. = 5.20) 

Quantitative Tliinkitig (iJif./SEdif. = 3.‘17) 

General Vocabulary (DifySEdif. ^ 3.07) 

The foregoing results, while limited in scope, suggest that there 
are systematic qualitative diffcreucos between briglit and dull 
children of the same MA and that tho validity, meaning gen¬ 
erality, of tile Mental Age concept is open to some rjuc.sliona. 
Between children widely separated in Chronological Age qualita¬ 
tive differences in i\IA may well be foirly large and carry with 
them different meaning ho far ns huccoss in school is concerned. 
However, the hitter point is prineipuliy yet to be dctermiiicd, 
since, in addition to the 8inuIlne.Ks of the Hiimido used in this 
investigation, some of tho subtesls of the Primary Uenlal 
Ahililm tests do not correlate liighly with KchoUistic achievement. 
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La-WRENCB a. AveiuI/L. The Psychology of the Elementary School 
Child. Now York; Longmans, Green and Co., 1949, pp. 459. 

Tills book IB addressed to teachers of elementary school 
oliildren rather than to the student of child psychology. It will 
probably find greater use in departments of education engaged in 
teacher-training than in departments of psychology or child 
development. It covers chiefly the child of elementary school 
age, although there is one chapter, 16, rather a minor one, devoted 
to Early Childhood Training. 

Tlie book lives up to its title. It treats the psychology of the 
elementary school cliild, not tlic psychology of teaching the 
elementary school subjects. Additional chapters are as follows: 
Personality Adjustment of the School Child 
The Emotions of tho School Child 
Attitudes and Habits 

Physical and Motor Growtli and Development 

Play Interests of Children 

Social Development of Children 

Language and Speech 

Imagination and Maicc-believo 

Juvenile Aesthetics 

Maturation and the Motivation of Learning 

Intelligence and Individual Differences 

Meaning and Perception 

How Children Lcarii 

How Children Think 

Guidance 

The author seems to reflect the training he received at Clark 
in what may be eallod the classical period of Hall and Burnham. 
The book is stylishly written and on the whole presents the 
teacbor-in-training with a pretty good description of what 
elementary school children arc like, ]3sychologically. It has 
occasionally occurred to the writer that the children pictured are 
ideal childrcm or (Otherwise a bit unusual, although this impression 
may well result from tlic author's stylo of writing. The book 
presents tlie child of school ago in action. It is written out of a 
wide experience. Since there is not a great deal of documentary 

S9 
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or experimental evidence prcBcnlcd, an hiHtniotor with limited 
background might find the book a little difficulL to teach. It 
seems that aludenla will enjoy rending it. J. 11. l^TuotJU 

State University of Iowa 

G. W. Paiikyn. Children of High InUiligcncc. Auckland, N. Z.: 
Now Zealand Council lor I'klucnlionul llcsoarch, 11)18, pp. 
228. 

This volume is a prespnlation of the dula from a study designed 
to provide information about highly intelligent children in 
Now Zealand. 

The author briefly discusses the meaning and importance of 
high inLeliigcncc drawing heavily upon Iho svork of Burt, Spear¬ 
man, and HoUingaworth in the formulation of his concepts. lie 
also reviews the studios by Terinan and others in tlie urea of 
characteristics of gifted or liighly intelligent children, lie prefers 
the term high intcUigeiico, reserving gifted for individuals with 
specific talents. 

The data in the six-year intensive and extensive Hurv(?y \va8 
based on three groups of children in Ihcupjicr live jior c<?nt of the 
population as determined by Blundardizcd intclligcuco tests, 
The two groups solocted by moans of tJic Oli.s Self-A/lrniniKtcring 
Test of Mental Ability wore used for sUliatical treatment wliilo 
detailed case study methoils were apj^ied to iv smaller group 
selected by means of the Kevised Stujibjrd llinet Siuilc 1087. 
Within the limits of the instruments and incLlioda used, the study 
was carefully carried out and cautiously analyzed with recogni¬ 
tion of several possible interpretations. 

The conclusions indicate that with the exception of (liiTorcncca 
resulting from local cultural and social influoncos, the cluiractor- 
istics of children of high intelligence in Now Zealand are com¬ 
parable to those of children studied in llio United iStates and 
England. 

The remainder of the book is devoted to stating the problems 
involved in the education of highly iulcUigout oUiUivi>n, including 
learning, teaching methods, curriculum and ability grouping. 
He concisely gives tho advantages and cliRudvantagcH of tlio 
various approaches used in other coimlncs, Iho iirosent status in 
New Zealand, and sfiggosUons for reorganization. 
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Wliile tho author is open-minded and strongly advocates 
experimentation to determine the best methods for educating 
children of high intelligence, his present point of view is rather 
conservative. 

There is little that is new in the book. It’s contribution is in 
its rc8um6 of previous studies and its verification of earlier data, 
in tho fair ))rosontatiQn of contradictory points of view, and in 
the summary of tho problems. Gwen F. Arnold 

The University of Wisconsin 

Charles Mourns. The Open Self. New York: Prentice Hall, 
1942, pp. 174. 

This is a book with a thesis and moral lesson. In essence, the 
sermon is: Diverse open selves united on the common ideal of 
an open society of open selves can defend, celebrate, and enhance 
their own and each other's uniqueness.^' This doctrine of open 
selves in an open society is presented by Morris in a very con¬ 
vincing manner, and in his presentation he reveals a familiarity 
with philosophy, psychology, sociology, ns well as expresses an 
interest in the welfare of mankind and the destiny of man. His 
sense of values is fundamentally sound and matured; his direction 
and raoliiod for attaining goals in society arc well expressed, 
and tho book is well written under such popular captions as 
"Man as Ills Own Maker,” "Man's Knowledge of Man," "A 
Primer of Semantics," "Ways to Live,” “The Catacombs of the 
Self,” "The Universe of the Many," “The Open Society of 
Open Selves,” and "Freedom or Frustration.” 

Of interest to educational and social psychologists is the 
author’s report of a survey of a thousand college students giving 
their reaction to thirteen possible ways of life, with the con¬ 
clusion that forty per cent choose dynamic integration and 
diversity. The thirteen ways to live are identified with philo¬ 
sophical statements and quotes from literature well known. 
Illustrative is Path Number One. Here the individual actively 
participates in tho social life of his community not to change 
it primarily, but to understand, appreciate and preserve the 
best that man has obtained. Another path. Number Four, 
is that life is something to bo sensuously enjoyed, enjoyed with 
relish and abandonment. Still another is the use of the body’s 
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energy as the secret of a rewarding life. The conclusion is that 
most people favor diversity, and the next largest number— 
Bevontaen per cent—favor nothing in excess. Another ten per 
cent favored careful, wholesome enjoyment. 

The doctrine of the open self and open society ia offered by 
Morris as the only solution of man's ills and anxieties of the 
preBcnt time. This ho pvesentB as the most preferred road to 
freedom, because, us he sees it, the totalitarian society flourishes 
on the food of anxiety, is temporarily effective through its 
promise to relieve anxiety, but is ultimately unsatisfactory 
because it lives only by the perpetuation of anxieties. His diag¬ 
nosis and proscription is relatively simply expressed; it is merely 
that the danger of America is not senility but sterility, tliat the 
new American frontier is human rather tlmn geographical, and 
that the now American frontier marks our rcspon8il)ility and our 
opportunity. In his actual proscription ho reveals tI»o funda- 
mental soundness of his phllo.'sophically-dctcrmincd goals and 
also reveals one obslaclo toward clear undcrslanding that runs 
through the book; namely, identifying of peraonalily traits from 
Hornoy’s writings of dominance, Kul)miKsion and clopondenco 
with Sheldon’s conoepts endomorph, mo8omori)!i, and ecto¬ 
morph. In his prescription ho presents it in tins fuHinon: "We 
need our ondomorpha to keep ua humanly warm, our cetomorphs 
to keep us humanly sensitive, and our mesomorphs to keep us 
humanly bold and adventuresome, and on this frontier wo can 
advance together. Hero wo can use all of oursolvcH." All is 
well, all is right and all is in line witli liberated thinking of the 
day. What ia unconvincing and somewhat irrelevant is his 
hook-up of human values with Sheldon's concepts loosely con¬ 
sidered. If Morris never knew anything about endomorphs, 
ectomorphs and mesomorphs, lie would have written an even 
more clearly, more intelligible book, more understandable by 
more people for whom the volume is written. II. Mkotzeu 
P sychological Servico Center 
St. Louis, Missouri 

Jea.n Paul Sartub. The Psychology of Imagination. Now 
Yorlc: Philosophical Liljrary, 19‘18, pp. 280. 

An existentialist takes an excursion into tho phonomonology of 
imagination and the imaginary in this book called The Psychology 
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of Imagination by Joan Paul Sartre. What the author says he is 
trying to do is “describe the great function of consciousneBS to 
create a world of unrealities of ‘imagination’ and its noetic 
correlative, the ‘imaginary.’ ” What he calls the image family is 
considered by him in Part I under the caption of “The Certain.” 
This includes a consideration of such topics as the sign and the 
portrait, the consciousness of imitations, schematic drawings, 
faces in the fire, spots on the wall, rocks in human form, hypna¬ 
gogic images and persons seen in coffee-grounds and a crystal ball. 
Part 11 is entitled “The Probable.” Here are considered suoh 
items as knowledge, affectivity, movements and the r61e of the 
world in a mental image and how the things appear in a mental 
image. Part III, called “The E6le of the Image in Mental 
Life,” includes a uonsideration of the symbolic schemes, and Part 
IV, "The Imaginary Life,” includes a consideration of image 
and perception, the unreal behavior, pathology of the imagination 
and the dream. The concluding chapters consider consciousness 
and imagination and the work of art. The book contains an 
index. 

The image and the perception are considered by Sartre as two 
elementary psyeliicnil fiieloi-s of similar quality which represent 
the two main irreducible attitudes of consciousness. The easiest 
way to reveal the nature of the content found in this book is 
through illustrative quotc.s: 

“For nn image is not purely and simply the world negated, 
it is always the world negated from a certain point of view, 
namely, the one that permits the positing of the absence or the 
non-existenco of the object present ‘as an image.’” (p. 268). 
“Nothingness can present itself only as an infra-structure of 
something. Tlic experience of nothingness is not, strictly 
speaking, nn indirect one, it is an experience which is ‘in’ principle 
given ‘witli.’ ” (p. 271). “The unreal is produced outside of 

the world by a consciousness which slays in the world and it is 
because he is transccndcntally free that men can imagine.” 
(p. 271). “Tlie values of the (Jood presume lieing iii-the-world, 
they concern action in the real and arc sul) 3 cct from the outset 
to the basic absurdity of cxistonoc. To say l.lmt we assume the 
attitude of cHthetic altitude to life is to constantly confuse the 
real with the imaginary.” (p. 281). 

The foregoing illustrated quotes reveal the style and the intel- 
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lectual excursion Iho rcadoi’ would take with tlie oxistentialiat 
und novelist who himself takes an excursion into what Ivo thinks 
is the psychology of imagination. 

To SatU'c’s consideration of the negative one is tempted to 
react with Morris Bishop’s short poem in tlic recent issue of the 
New Yorker called “Not Unmindful of tho Negative aa I am Not” 
which ends with the line, “If Nol’s not not, then prithee, what's 
Not not?” 

The Chips are Down ia tlic name of a short novel hy tlie author 
and well describes tho attitude with which persons wlio are 
scriouB students of psychology without an interc.st in side-track 
reading arc likely to emerge if what they expect out of this volume 
is a factual consideration of what psychology knows about 
imagination. The Chips are Dmon for such readers. Only if 
they are willing to take an excursion with Sartre's iutelloctualiz- 
ing about imagination will they get any onjoyinenl out of the 
boolc. II. Mtoltzisu 

Psychological Service Center 
St. Louis, Missouri 
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STUDIES OF THE GROUP RORSCHACH 
IN RELATION TO SUCCESS IN THE COLLEGE 
OF THE UNIVERSITY OP CHICAGO* 

LEE J. CRONBAGH 
IMii-oaw of Research and Service 
College of Education, University of IllLnoie 

‘Wiclcapread inlercst has been aroused by Mimroo’s monograph^ 
on the adjustment of college students and their scholastic suc¬ 
cess, in relation to predictions based on the Rorschach test. 
Miinroc found that even a rapid scoring of the Group Rorschach 
yields a useful pi*<i(Uctov of academic success, and that the test 
draws attention to studonla likely to need help in emotional 
adjustment. Tlic Miinroe study leaves need for further research, 
however. Sarah lyawrcmcc College, with its methods of adapting 
the curriouluin to the individual, is aufTiciently atypical that 
findings there may not apply clsewlicre. Further studies are 
also needed to obtain a clearer indication as to what aspects in 
tlie Ilorsclmcli perfminiincc contrilmtc to the predictions. 

Many colleges have planned studies along the linos of the 
Munroe work. Some reports, generally supporting the claim 
that Ilors{;hach data have predictive value, have appeared.*-'’'^ 
Some of tbivS ovidenee, however, is weakened by faulty statistical 
reasoning, ‘ The present study was begun as a direct repetition of 
the Munroe study, to predict academic success at the University 
of Chicago. As the sUuly proceeded, the mass of data collected 
made several other studies possible. The present report is a 
statistical ihroslting of the material available. Clinical analysis 
is also planned at a later date. 

* This Hludy wa.s phiiiopil ami dftltt wore asRoinbled by Lho Univeraity 
Examinfii-’s ()(li<!(> of llu; Univeraity of (’hionfio. Contributions to tho study 
woi-o made by Honjaniin K. Wooiii, (iRorge Do Vos, Esther A, Frankie, and 
Harriot Moore, Tlie present writer is priiniirily responsible for the analysis 
and interpretation. 
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Basic data .—The College of the University of Chicago is the 
top unit in a syatem, comprising grades Xl-XlV of the 
ladder. According t-o Ibo Chicago plan, sLmlenls lalfo 
general courses in several major areas, the work lieing i)rcaenLe(l 
principally through small discussion cla.sscs supplenumted ))y a 
weekly lecture. The student is much Iobh closely HUporvised 
than lie would be in the usual high school. Ilis o/licial record of 
progress is based exclusively on comprehenHivo examinations 
given at Llic end of the school year, rather than on such bases as 
class attendance^ teacher marks, and toachcr-mado tests given 
throughout the year. These tests aro prepared, given, and 
marked by a central examining staff. 1711110 the tc.stoi's woi-k 
closely with the instructors in preparing tests, the final form of 
the examination is prepared by the examiner and tlie final grading 
is made without knowledge of the identity of the writer of each 
paper, and thus is free from certain types of bias. Tliis practice 
provides an especially interesting and reliable criterion for a 
study of the Rorschach as a predictor. The examinations 
empimsizG comprcliension of principles and development of 
intellectual skills, rather than recall of i.Holatcd facts. 

In 1940, a group of three hundred Hludents enUn’ing the College 
were given the Group Rorschach in the customary manner, and 
the Amei’ican Council Psyehological Exatninalkm. At the end 
of the year the comprehensive examinations in the Natural 
Sciences, Humanities, Foreign Languages, Social Sciences, 
Mathematics, and English were given. Subjects in the present 
study include only those students who took from three to five 
comprehensives in the first year; the grades wore averaged, with 
equal weighting, to yield the grade point average which is the 
principal criterion in this study. 

The subjects tested are not representative of the usual ‘college 
freshman.’ Most arc from homes which can afford a substantial 
tuition. They have passed severe entrance hurdles. They arc 
young, the median ago being about fifteen. They are intellectu¬ 
ally extremely superior; on the ACE tcsl, total score, aiiproxi- 
matcly fifty-three per cent surpoas the ninetieth percentile of 
the national norms for thirteenth-graders. The group undoubt¬ 
edly have special motivations which cause them to seek out the 
"University of Chicago program. 
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Problems invesligaled .—^TIio follo^Ying questions are considered 
in this report: 

(1) What are the cliaracteristics of these students in berms of 
the major categories? 

(2) How adequately does adjustment judged from the Ror- 
achach predict success at Chicago? Docs it onhauce prediction 
based on the ACli)? 

(3) What signs in the Munroc check list are associated with 
academic overacliicvemont or imdcrachievement? 

(4) What signs are correlated with the ACE score, and with the 
difference between Q and L? The latter question was raised by 
Muiiroc’s study® that links the pattern of abilities to personality. 

(5) How does Rorschach performance relate to ratings of social 
adjustment and to personal cfTectiveness as measured by socio- 
metric techniques? 

It ie the purpose of all these questions to identify the possible 
usefulness of the Group lloi*schach in college personnel work. 

Analysis of the dala .—^Hccausc of the intensive analysis planned, 
a thorough scoring of the Rorschach was made. A first scorer 
had marked the check list in a very rapid fashion, and treatment 
of the rosuUs .showed that the data did not predict marks. But 
it was apparent that somo responsca which should have led to 
entries on tlio clicck lint had liccii overlooked in the hasty scoring. 
In a rescoring by one of two new scorcra, eacli Rorschach response 
was scored. The cheek list was then marked carefully by tlie 
scorer, and in many cases the checking was reviewed by the other 
scorer. The data may have been analysed more intensively 
than Munrou's records, u'hich would lead to somewhat higher 
check-list score.s, on the average, for this group.* The second 
scorers also assigned a Icllcr grade indicating estimated adjust¬ 
ment, using hlunroe’H scale,♦ (p. 2i) which ranges from A (sound 
integration) to E (psychopathology). 

Contamination was eliminated by the facts that Rorschach 
findings were not mtitle available to iiislructors or examiners, 
and that seoi-ers marluMl the tesla without knowing the students 
and without nsfeuring to non-test data other tliaii age and sex. 

•In lifter roiiipIeliiiR lli« Htmly, it niiiioniH tliat the ra])i<l 

u'.'UU^’V IvttUer wot wotBC v'w.du‘.LttiiuH llmu tlvo, more caresful 
check-list HCiiriiig. 
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RESULTS 

Because time was nofc available for rescoring all records, only 
two hundred cases—a sample of the three hundred persons tested 
—were used. These are a random Bample except that all seventy- 
two of the cases residing in college dormitoiies were includod. 
Table I summarizes the dislrihutiou of cases. Tliei'o were, in 
all, seventy-one men and one hundred twenty-nine women. In 
aotno analyses^ the first-year group was treated separately from 
the advanced students. 

Table I.— Subjects Classified «y Age, vSex, and Guade 
Placement (N = 200) 


riaccinont nl Time of Knlraiico 


Age 

First Year 
(lull grade) 

Second Year 
(12lh grade) 

TJiird Your 
(ISlh grade) 

FourtliYenr 
(Mill grade) 

Total 



I 

Women 

Men 

Women 

Men 

Women 

Below 16 

1 


0 

n 


0 

0 

0 

7 

16-0 to 16-11 

20 


3 

2 


0 

0 

0 

60 

lfl-0 to 10-11 

2't 


7 

7 


0 


0 

61 

17-0 to 17-11 

1 

1 

iBI 

8 


0 


0 

28 

18-0 to 18-11 

0 

1 

■I 

■■ 


3 


0 

0 

10-0 to 10-11 

2 

0 

■1 


1 1 

2 

0 1 

0 

6 

20-0 Over 

2 

0 

11 

u 

29 

2 

8 

0 

41 

Total 

02 

41 

10 

17 

43 

13 

8 

0 

200 


RORSCHACH CKARACTERIfiTICS OP THE SAMPLE 

Our first question is what the Chicago gi oup is like, as redcctccl 
in Rorschach performance. One way of looking at this is to see 
how frequently each of the Munroo ‘checks* occurs, simio a 
check is allowed for each variation in personality which may sug¬ 
gest adjustment difficulty. This tabulation is not so ri(!li as a 
clinical analysis of each record would be, but it is ndatively 
objective. The incidence of signs* in fclie Gliicago group was as 
follows; 


* Theao eigna arc vtsocl aa defined by Munroo^ (pp, 87-101). 
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Siiidies of the Group fior8c?iac^ 

Ovcv 50 pev cont of tiie subjects showed: shading shock (83 
per cent), color shock (92 per cent; two checks given to 67 
per cent), FC- (50 per cent), C:M-(C6 per cent). 

31-50 per cont of the subjects received one or more checks for: 
S-k, AtSx+, F(B or V), FKFc—, m+, Total Movement+, 
Total color — . 

20-30 per cent of the subjects received one or more checks for: 
W+, Sue r, ilange—, F per cenfc+, M-H, M —, CF-k. 

Munroe has provided us with the incidence of signs in one 
hundred twenty Harah Lawrence freshmen (girls), entering in 
1945-1917. The general distribution of signs resembles that 
at Chicago, witli certain marked exeepUons. The following 
signs were noted by Munroe in at least ten per cent more cases 
than at Cliicago: GF~, Range—, \V4-, Total mvt.-k. The 
Chicago scorers noted these signs at least ten per cent more 
often: Cd-, Sue r, F(B), F(V), AtSx+, Total color — , Sd-, 
FKFc — , md', FC —, G:M—, slmding shock, color shock. The 
most striking differences in incidence relate to sliading shock 
(Chicago 83 per cent, vSarah Lawrence 35 per cent), color shock 
(92 per cont, GO per cent), FC— (6G per cent, 28 per cent), m-k 
(40 per cent, 14 per cont), FKFc— (37 per cent, 7 per cent), and 
Sue r (27 per cent, 0 per cent). 

One cannot ho suns that in a group having exceptional scho¬ 
lastic aptitude the .signs of maladjustment are the same as those 
for persons roisrcKonling a broader range of ability. Moreover, 
the differences in age and sex between the two samples are too 
great to permit conlideut inlerprclation of the comparison. 

If the conventional llorschacli interpretations hold for this 
group, the Chicago students sliow a larger number than usual of 
signs of cmotioniil disturbance (shading and color shock, F(BV), 
AiSx, m), inflexibility (,S, range, F per cent), and inward rather 
than outward oi iontation (M, color). The principal quantita¬ 
tively-scored difTeronce from the Surah Lawrence group appears 
to bo in the color ludunce—CJhicagciaiiK tending relatively more 
toward C and Ch' than FC -mnd in lh(! tensions represented by m. 
If the scoring in the two scliools on more qualitative items such 
a.s color shock can ho eompnrc<l, the Chicagoans arc also less 
flexible and more prone to emotion in Lhrcaioning situations. 
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niKDICTION OF GllADB AYBIIAOK 

Docs the llorscliacli improve prcdiclUm of griuicH l)o,yon(l that 
obtained from the ACK Test? Tlie uunwer given by our data is 
almost completely negulivc. The correhitiona of grade average 
with several variables arc as followa: 

with ACE Total .45 (liml yeur), .31) (Sd-ltli year) 

with number of liorsdiach 

checks .17 (first year), .00 (other years) 

with Ilorsclmclr adjustment 

rating .25 (first year), .07 (other years) 

Positive correlations show that good adjustment is associated 
with good grades. For one luindred eases, a product-jnoinout r of 
.00 has a standard eri-or of .10. The correlation of Uorscliach 
grade witli ACE Total Ls .11 (first year), .29 (otlun* years). A 
multiple 11 computed from AOE and Ilorschaeh grade is .40 


Tadle II.—Kousciiacii Adjobtment IIatino CoNiniNnn with 
ACE IN Uelation to Academic Standing (Fikst-yeau 
Student.s) 


Roracliach 

High AC'l'i 
(22* nml over) 

Low A(3’I 
(Holow 22) 

Grand 

Total 

A or 

P 

G 

D or 
E 

Total 

A or 
h 

1 

I) or 
E 

Total 

Grade averngot 










3.0-3.0 

8 

m 

i ^ 

18 

0 

4 

1 

, 11 

20 

2.0-2.9 

0 

9 

2 

17 

■1 

15 

8 

27 

44 

1.0-1.9 

1 

2 

1 


■1 

11 

5 

20 

24 

0.0-0.9 

1 




1 

l' 

0 

2 

3 

Total numlicr 

10 


A 

40 


31 

14 

GO 

loot 

Percentage eaining 








■ 


3.0 and above 


45 

25 

46 


13 


18 

20 

Percentage falling 







H 



below 2.0 

12 

m 

25 

13 

33 

30 


37 

27 



1 


- - 



■m 




* On a htnndard-scoro scale with mean 20, s.d. 4. 
t 3.0 equals I). 

t ACE scores were missing for three eases. 
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(first year), .39 (other years). The improvement over predic¬ 
tion from ACE alone is negligible. 

Table II, corresponding to Munroe’a Table VIP (p. 49), shows 
the grade distribution for each combination of ACE and Ror¬ 
schach standing.^ for first-year students. There is some rela¬ 
tionship between the Rorschach and grades earned. Bright 
students tend not to oarn^high grades, unless they have at least 
a fair degree of adjustment. With low ACE score, students’ 
chances of receiving high grades rise or fall in proportion to their 
adjustment. Tho trend is insufficient to affect the multiple 
correlation appreciably. These sub-hypotheses regarding tho 
interaction of Rorschach and ACE scores might prove to be 
significant in a larger sample of cases. 

CIIAKACTEUrSTICS FAVORING ACHIEVEMENT 

Even though the total Rorscliach score does not predict 
achievement, there may be some traits revealed by the Rorschach 
which do correlate with academic success. The separate signs 
in tho Munrotj list were thcroforc correlated with tendency to 
underachieve. To do this, tho scatter diagram between ACE 
Total and Grade Average (for all three hundred cases) was 
divided into two parts. The twcRty-fifth percentile was found 
in cacli column rcpre.scjitingan AClSscore-inlcrvaJ, and a smooth 
line was drawn through these points. In the sample of one hun¬ 
dred nincty-sovon caKes for whom wo had ACE scores and 
rcscorcd Ror.schaclis, the line cut off sixty-eight undernchievers, 
One hundi'od twenty-nine cases fell in the nurmal-to-superior 
group. This divisitni permits comparison of students who differ 
in achievement with ACE score held constant. The failure to 
divide tho group in ilic ratio 25:75 reflects smoothing and group¬ 
ing, ratlier than differences between tho rescored group and the 
parent group. 

The two subgroups were compared on all the check-list entries, 
and on a few other scores. Relationships were generally negligi¬ 
ble. The relations in Table III arc reported only as leads for 
further rosearcih. What trends there were seemed to be linear; 
no sign is eluiractcn’istic of l)oth overaobiuveis and under¬ 
achievers to a greater degree than normal achievers. Not a 
single one of the forty-four relatioiislups machos significance by 
the chi-sc)uarc Lost, both variables being dichotomized and 
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Yatos* correction being used. Virtually none of tlicse signs are 
confirmed by Tliompson’ ns having a relation with gradcjs, AC]3 
Bcoro being held constant. There is no basis in the present study 
for advising further attempts to prctiict marks at C’iiicago by 
statistical treaimeut of Roi'Hehneh cheek-li.st enlrkfs, 


Taijle III.— UonsciiAcii SiONft IIavino Tusitivk imit No*n'- 
BIGNIFICANT llliLATION.S n’l'l’l[ UNDIUIACIIIIOVKMKN'T 


Charactorlstlc 

Percentage 

Over- 

achievers 

and 

Normal 
AchiovorH 
(N « 120) 

Incident;!! 

Under- 
Achievers 
(N - 08) 

^■i.t 

W- 

10 


.28 

0 4* ++ 4' + 4' 

10 


.26 

Tot Movement + ++ d-d-4- 

43 


.24 

FM 4- 4-4- -1-4-4- 

23 


.22* 

Dd 4- 4-4- 4-4-4- 

Id 


.18 


* Product-moinDnl r. 


CORRELATION WITH ACE RCOltE 

Because there has been, much iutevesl iu the possible relation 
between Rorschach performance and tested intolligenco, a com¬ 
parison was made between tlie ACI'I total score and each of the 
check-list signs. In this high-level group, with reslri(!ted riuigo, 
tetrachoric r's Avoro nil small, save that VKli'c— corrolaLed — .dC 
with ACE total. Chi-square, correeied, for EKFc was 0.3 
(but this Avas only one out of twenty-five signUuauuic. L(‘Kts in this 
section of the study, and is therefore barely signirKtanl if at all). 
Other non-significant correlations were J)(l-|-, .dO; —.30; 

C'-b, .30, FM-f, “.25; m+, ,26; M-h, .20. These associations 
are so low as to discourage attempts to make a statistical estimate 
of psychometric intelligence from the Rorschach signs in a 
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group ssucli ua this. The unreliability of single-test signs would 
obscure any underlying relationship. High ACE score is associ¬ 
ated with presence of FKFc, Dd, FC, C^, m, and M responses, 
and associated with infrequent use of PM. In a corresponding 
study with less homogeneous subjects, Thompson^ found similar 
associutionfl for M, FM, and m, and apparently for FC. Low 
Dd was found with high ACE in her group. Her scoring does 
not permit compaj’ison of the two studies on FKFc and C'. 
On the otiier imnd, she lists numerous correlations (significance 
not reported) of ACE with Korschach signs which were found not 
to be differentiating in the Chicago group. Wittenborn’s 
recent atudy® of a small sample suggests that few relationships 
between llorschach scores and mental ability exist for college 
students. lie finds slight association of tested ability with 
R,, M, and C'. 


TUB Q-Ii DIPPEJnENTIAU 

Munroc found numerous Rorschach differences between girls 
with L higher than Q and girls with Q higher than L on the ACE. 
Our data are in sliglitly difTcrent form from Munroo’s, but permit 
further investigation of the same question. Because of the pre- 
Boloction of Chicago students, our cases come from a markedly 
diffoi'ent portion of the Q-L plane than here. 

Our Higher L group consisted of all students whose standard 
score ill L was at least ^ s.d. higher than their Q score. The 
Higher Q group cansists of those whose Q score was at least 
Yi s.d. higher tluin their L score. There were nine, twenty- 
seven, and thirty girls, respectively, in the Higher Q, equal, and 
Higher L groups. In the same categories, there were respectively 
thirty-seven, forty-two, and forty-four men. Because of this 
sex clifforoiico, wo tabulated Rorschach performances of the two 
sex groups separately. For significance tests among the girls, 
the equal and Higher Q groups wore thrown together. Among 
men, significuiujc tests were based on chi-square applied to the 
Higher (i v(!r.suH the Higher L group. 

Absolutely no diiTereneo was found which could be considered 
statistieally signific.ant. On many items, small differences 
appoar(i(l in one sex but were accompanied by just the opposite 
difference in the other sox. Munroe reports five significant 
differences: Higher L is associated with high M per cent, high 
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total movement, high high CV, and low T per cent. 

Among our sample of girls, there was no dilTeronee in F(IIV), :\I, 
ntid Tot mvfc., n dilTcvcncc confirming Munruc in F jjor cent, and 
n differencG eontrnry Lo Munroc's in C^ The lendtmey of Higher 
Q girls to show excess F per coni is not HlatiHlu’ally significant, 
but it is in accord with previous reiiorts by and Munroo. 

Among girls, the perconlages receiving u cheek for ovtironiphuHis 
on F per cent wore: Higher (J, nitiiul, llj Higher L, 7. Among 
boys, the percentages wore 43, 31, and 2{». 

In our bamplo there is no apprcciabk; rohiLion Ijolwopn Uor- 
Bclmch scores and the abifily pattern. It may lu! that this is a 
result of special characteristics of the Cliicago sample. Kvon 
the lowest of the Higher Q Hludents at Chicago probably has 
considerable ability along linguistic lines, or he woultl not Jmvo 
reached the College, l^urthormoro, the Chicago j)j‘Ograin, whicli 
stresses general education, may not nltrnct students with cxlromo 
overspccialization in oitiicr the linguistic or (pmntitative direc¬ 
tions. Our results do delinilcly (Iim:o\u’uge generalization al)out 
"tho type of personality likely to have (i greater limn h,” and 
vice versa, until further research has been done on Hul)jeels of 
many levels and many ages. 

niKDICTlON OP BOCIAL ADJUST.Ml-JNT 

Munroo found that Uorschnch scores i)ei'mitted lior to predict 
which students would later sliow signs of maladjustment, as 
judged by their use of psychiatric; service and other evideiice. 
No criterion availalde at Chicago is directly enmi)aral)le Lo 
Munroc’s. As one criterion of malndjustmcut, ratings from 
dormitory resident heads were obtained. For each lir.sl-ycar 
student living in a University residence liall (and this includos 
all those not residing at home in Chicago), tlic lioad of the 
dormitory unit in which ho lived supplied u rating. Twelve 
raters were involved, each one rating from three to ekwen kLu- 
dents. No student was rated by two heads. Tlio raters were 
professional people living in tho dormitory and working with 
the students, but they had vcjry limited psychological training. 
Tlio rating was made on a five-point scale which paraphrased 
Munroe’s scale used in assigning Hoi'fichacli letter ratings of 
adjustment. 

The correlation of the Dormitory Rating witli Rorschach letter 
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rating is: for forty mou, .38; for thirty-two women, .31; for both 
combined, .31. The firat correlation is significant at the one 
per cant level, tlio second at tho five per cent icvcl; the null 
hypoLlicsis may bo rojected. In view of the doubtful reliability 
and validity of the criterion, the correlation encourages the 
belief that tlie llorschach may prove useful in predicting social 
maladjustment in college. For number of checks, the correla¬ 
tions were: men, .27; women, .20; both, .24. Although we have 
no idea what to conclude, wc must report the additional fact 
that for all cases combined the mere number of Rorschach 
responses correlates .33 with Dormitory Rating. 

RELATION OF ROIISCIIACH llESULTS TO SOCIOMETRIC RATINGS 

A second criterion of adjuslmt^nt which may have considerable 
validity is a sociometric report obtained by Franlcle.^ Each 
resident of tho dormitory w'as asked to rate each other resident 
of tho same sex on a 'Guess Who,' or reputation, questionnaire. 
Tho questionnaire presented twenty bi-polar items; for example, 
“Which ones [in your dormitory] always seem cheerful and good- 
natured? Who are tho onc.s who never look happy; always seem 
sad, worried, or frustrated?” Each person was provided with 
a list of all students of like sex residing in any dormitory, and 
wa.s li.skod to write after each question the name of any person on 
the list who fitted the description. Respondents were allowed 
to name several persons for one question, or to omit names if 
the descripLioii fitted no one. While the students had been liv¬ 
ing together for a year, the dormitories were physically divided 
into 'entries,' ho lluit each person knew a few students in his 
entry better than others in the group whom he saw only at mcal- 
times, in tlic lounge, and in general contact about the campus. 

Among tho twenty trails, there were five, such as 'shy versus 
sliow off,' wliich could not l>o considered ns having one ‘good’ 
pole. Eliminating these five items, the other items could be 
considered tiH providing an index of adjustment, since mention in 
connecition with (me of tho questions was obviously a favorable 
report, and tin; other tjueslion implied unfiivorai)lc adjustment. 
Eleven of tlie traits arc listed, in condensed w()i‘ding, in Talkie IV. 
The lotal number of mentions under favoralde traits, minus the 
number iinder unfavoral)lc Iruits, was taken as a Sociometric 
Rating of adjustment. This score may be taken ns a net appraisal 
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Table IV.—Relations between Tiiatts as Rbpouticd in 
Reputation Questionnauib and iSelectep IIohsciiacii Check¬ 
list ICntbies 


Qucationnftiro Item 
Always scemH worried (vs. 
cheerful) 

Makes people foci com¬ 
fortable (vs. makes 
people MncomforVablo) 
Jumpy, jittery (vs. calm, 
unperturbed) 

Always baa something to 
gripe about (vs. handles 
probloms adoptively) 


Ovorcmotionnl, oxcitablo 
(vfl. cold and unmoved, 
overcontrols emoiiona) 
'Show off,’ always trying 
to attract nltcntion (vs. 
shy) 

Must bo with other pcoplo 
(vs. prefers to bo by self) 
Acts Hko a 'high-school 
kid’ (vs. mature) 


Intorcsted in the abstract, 
theoretical (vs. concrete) 
Spontaneous, flcxiblo (va. 

rigid, can't change views) 
Withdrawn from reality, 
daydreams (va. rcalUtic 
attitude) 


('lioek-liHt lOntrics 
Magni- Having rLcHS 

tudo of 'niiiii .20 with 

Tetrn- CimtHlionnairo 

Associnteil with chorin r linn 


Shading nhock 

.25 

AlS.x, l‘%. (V, M 

KniplinsiH on Kk 

.fiO 


ICmphnsifl on c 

.‘iO 

M, Ci.l Hh, (;:M, 
FC, FKl-V, F% 

Kmplmsis on m 

.-lO’ 

M 

TJndcrcmphasis on 

.40* 

M. F%, F(BVK) 

8 

Undcrcinidinsis on 

.25 


FKFo 

Undcrcnii)hnsiR on 

.55 


FC 

Kmphosis on 

.50 


Undcrcinplioaia on 

.40* 

M. F% 

FC 

Kinpliaais on (IF 

.35 


Kmplmsis on Kk 

.20* 

Tot C, C:M, FKFc 

Shading shock 

.40^ 

Color shook 

.3(y- 


Kmplmsis on OF 

,40 

Tot C, (L M, F% 

Undcremphasis on 

.26* 

M, CF, FKFc, A% 

FM 

Kmphasm on FC 

.35* 


Kmphasis on C 

.40 


High F% 

.26* 

W 

Form not BYE 

.36 

F%, U, CF 

Kmphasis on M 

.05« 

]>'%. F(l)VE) 

Undorcmphoaui on 

.25* 


FM 


* Relationship is in dirocUon opposite to that bypothosized. 

«Lowest marginal total is only 12 por cent; when cut near middle of m 
continuum, r drops to .12. 

^ No advance hypothesis ns to probable dirccliun of thin relnUnii, 

«Lowest marginal total is only 12 por cent; when cut is minhi near middle 
of M continuum, r drops to .06. 
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of tho studont by his peers. A large positive or large negative 
score is probably meaningful, although a score of zero could be 
achieved by a person with modiiim adjustment, by one whose 
good and bad mentions cancelled, or by one so inconspicuous 
that others were not acquainted with him and did not mention 
him. Kecausc of the possilnlity that the number of Mentions' 
might more nearly represent popularity than adjustment, the 
aociomoLric report was also scored by a weighted method, 
counting the numbor of traits on which the person had at least 
four more favorable than unfavorable mentions, minus the 
number of traits on which he has a net of four or more unfavor¬ 
able mentions. This gave results no different from the first 
scoring procedure. 

For men, the Sociomctric Rating correlates .284 with Ror¬ 
schach adjusiment rating; for women, the correlation is .140; 
for botli, .190. Tho correlations for mon and for tho total group 
arc significant at the five per cent level. But for all cases com¬ 
bined, tho numliar of Rorschach responses correlates .37 with 
the Sociomctric Rating I 

Many of the trait-descriptions in tho reputation questionnaire 
employed terms often used in interpreting the meaning of speoific 
Rorscluicli signs. For example, high F per cent is often thought 
to bo nssociiitod with ovcrcontrol. An examination of tho corre¬ 
lation between F i)or cent and frequency of mention on the 
charnctoristic ‘ovcrcontrols emotions’ is an unusually direct 
method of dolortnitung the validity of description from Rorschach 
scores. Each item in tho Reputation Questionnaire was examined, 
and a list made of all the Rorschach chcck-list entries that might 
be expected to correlate with that item, in view of tho meanings 
equated with llorsclmch scores in the Rorschach literatiu'e. A 
tetrachoric correlation was then computed between the score of 
the student on the bi-polar item (number of favorable minus 
unfavorable mentions), nml the frequency of the Rorschach 
oheok-Hst entry in question. Fifty-one hypoLhosos were tested 
in this jnanm;r. 

This pro(! 0 (luro is oiron to many criticisms. In the first place, 
analysis of scores one at n time violates tho Rorschach maxim 
that each score must be inlorprolcd in relation to the total pat¬ 
tern of tho subject. One hypothesis set up was that subjects 
who wore lacking FC would be rated ‘cold and unmoved, under- 
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controls emotions.' Hut some people scored FO— l)y Miinroo's 
method are high in CF, wlicrcas othern who lack FC lack all 
color and arc indeed *cold* perHonalilics. At hc.st, Iho aiiulyHis 
presented lici'o shows the extent to winch single llorschach check¬ 
list entries may ho interpreted, and docs not provide a basis for 
judging the validity of a clinician's iiitcrpretalion of an entire 
record. If some liypoihcsos were tried which, on the basis of 
'second guessing,' appear to have been unrcasonuiilc, it may he 
pointed out that the significance lost employed does not iienalino 
us for trying a large numher of improlinhlc liypolhcses. The 
significance test cmpIoyc<l iiilrodiices a penalty wlneh lowers 
aignificauce only ivlicn. the results turn out to he directly opposite 
to the relationship hypothesized. Another fitnious difficulty is 
the extreme unrclialnhty of tcUttehoric correlations, cspeciiiUy 
when one variable is dichotomized so that a small proportion of 
the ca 80 .s fall in one marginal total. No singlo correlation 
reported for this sample of seventy-two cases can bo considered a 
pi’cciso expression of a relationship. Finally, one may qucsticjn 
whether dichotomizing the, check-list entries and the repntation- 
qucstioniiairo entries Is entirely satisfactory. f)n the trait 
‘show o(T-va.-sliy,’ it might have been hotter to divide*, the cases 
into tlu'co groups, since some subjects showed ncuthor of the polar 
traits. Among ItoischacU scores, it might have hcon holler to 
separate the subjects into three groups such as iV—, M normal, 
iW+, rather than dichotomizing. Too few casc.s were available 
for this typo of analysis witli our data. 

We explored the possibility that (lifferent relationships Ijelivccn 
questionnaire items and llorecliach would bo found for men and 
women, considered separately. Some dilTereiuajs w(irc found, 
but the number of cases availublo to im are too small for our 
results to be worth reporting in detail. 

Table IV reports all correlations investigated betw’ccn Ibjr- 
schacli signs and reputation reports. Many coirclaiions hill 
below the arbitrary critical limit of ,20. 8omc of lluise failures 
to find relations are a contradiction of Uor.schach tlu?oi‘y. P(M)plo 
with absence of Fc or with excessive F woukl ))(5 oxpc'ctcul to make 
others uncomfovtablo; those with omphasis on W are presumed 
ovdinavily to be intevosted in the ahstruet anil theoretical. Iba- 
regarding two relationships where the direction of relation had 
not been postulated before studying the data, there were nine- 
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teen correlations greater than .20. Of the nineteen, twelve 
were in the direction anticipated, and seven were in the direction 
opposite to the hypothesis based on Rorschach theory. This is 
nob a significant elepavturo from the null hypothesis that fifty 
per cent of the correlations would fall in the predicted direction. 
(Tlie standard error of a p of 60, for nineteen events, is .11). 
This analysis therefore failed to confirm the validity of inferences 
regarding traits from single Rorschach check-list entries. Many 
explanations can ho advanced: the unreliability of single entries 
and the criterion, difi’crences in the use of such words as ‘mature’ 
by student raters and Rorschach interpreters, etc. Even after 
these attempts to rationalize the findings, paradoxes remain. 
Why, for example, should those with fewest S responses be those 
who ‘always have something to gripe about’? Why should 
those who ‘make people feel comfortable’ not be distinguishable 
on the basis of the major Rorschach signs from those who ‘make 
people uncomfortable’? 

Some of the relationships arc large enough to suggest cor¬ 
respondence between Rorschach signs and social traits. More 
thorough Htudie.4 using the reputation technique in well-knit 
gi’oui)s might yield considerable information on the relation 
between overt behavior and personality structure. 

fir/AfSfiiRr discussion 

The Group Rorschach records of two hundred students in 
the College of the University of Chicago were compared with 
grades earned, ACJ'l scores, and criteria of social adjustment. 
Tlie result.^ were as follows: 

1) Miinroe check-list scores of first-year students correlated 
.17 Avith average grade on highly’reliable and impartial corapre- 
hensive examinations. A subjective rating of adjustment as 
shoAvn in llorseluich performance correlated .25 Avith grades. 
Nciljhcr of thoHC oorrolations is high enough to enhance a multi¬ 
ple coi'ielulion at Chicago. Correlations for students in the 
second- to fourtli-year elassscs Averc close to zero. A breakdown 
shoAving tlu! interaction of Rorschach and ACl'l scores suggests 
that good udjusliuent may in pari compciiHnto for Ioav academic 
aptilu(l(5, hut this (Inding is bused on too fcAV eases to be accepted 
Avilh confidence. 

2) No statislically significant relationship could be found 
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’boUveDH undeTachievemont (grailn avcstagc with ACllC hold con¬ 
stant) and any single llorsclmeh indicator. 

3) Few single IloiHuhacli indicators showed tiny degree of cor¬ 
respondence witli total AOK scoro. None of the relationships 
was statistically significant, although hoiuo of them are in agree¬ 
ment with findings of xirevioUH studicH. 

4) Those data do not confirni Muiiroe’H finding of diiTerciit 
Rorschach patterns for Biudents with J; higher than and those 
with Q higlier than L on the ACK. No Kigniiieant difference 
could be found. 

5) Heads of dormitory unita rated HiudenU on eipotional 
adjustmeut. This rating correlated .31 with Ror.schach. adjust¬ 
ment rating. Tliis i.s a significant dcparliire from eiiainrc. 

6 ) Sooiometric descriptions of adjuKtinont were ohluined by 
having veaidents in Ihn dormitovy lUl out a vepulalion quesUou- 
naire. The total rating of adjuHtmciiL from this resport cor¬ 
related about ,20 with Rorschach adjustment rating. This 
correlation is ataiisiically signiricaiit. 

7) A large number of specific liypolhcses were Io.sUmI, based on 
the presumed correspondonce of single Uorscluudi (dieok-list 
entries with traits described in the roinilalion (lueHlionmiiro. 
The hypotheses based on Xiorschaclt theory were eonfirmed 
slightly move often than they were positively contradieted, hut a 
largo number of expected rclationsliips failed to materialize. 
The net confirmation of Rorschach hyi)utlio.s(‘S was not .sig¬ 
nificantly better than chance expectation. 

There can be little difference of opinion about tlie negative 
character of those findings. In the sample studied, tlu; Group 
Rorschach, obicctivoly scored, (ailed to predict scholastie success 
and gave only small cori'clntiona with criteria of social and 
emotional adjustment. Use of the Inspection Teclmi(iuo with 
the Group Rorschach for purposes of guidance in the GoUegc at 
the University of Chicago is nob warranted by tli(\se findings. 

This study does not substantiate the cUiims juude for objective 
treatment of the Group Rorschach. The only apprcciahlo 
corrolationa found are those relating Iho Group Rorseluich to 
dormitory ratings. And correlations of tho magnitude of .30 
with such criteria can bo obtained even with conventional 
questionnaires like tho Bernreutor, Tho only published evi¬ 
dence, gathered under sufficiently controlled conditions and 
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treated -with acceptable procedures, ■which favors the Group 
Rorschach as a screening and prediction device in college is that 
from Sarah Lawrence. The differences between Sarah Lawrence 
and the University of Chicago are so great that the contradiction 
between the two studies may be explained on many grounds. 
Perhaps ‘personality’ influences grades at Sarah Lawrence, but 
does not affect the comprehensives at Chicago. Perhaps Munroe 
has such superior insight that her scoring of the Rorschach is a 
good predictor of grades whereas the Chicago scorers were not 
able to assign such valid ratings (but this BUggestion is incom¬ 
patible with the view that the Inspection Technique is an objec¬ 
tive procedure.) Perhaps the selection of the Chicago group, 
or the difi'erent curriculum, accounts for lower correlations 
there. 

This study emphasizes the futility of quick and easy hypotheses 
as to the meaning of Ilorsclmch performance. One cannot look 
at a simple ratio lilce W: M and infer that the student will or will 
not pciforin as well ns liis ACE scores promise. If such a sign 
has any meaning, it lias meaning only when the interpreter takes 
into consideration the ago, sex, and level of intellect of the sub¬ 
ject. Hypotheses that may bo true for tho average patient, or 
tho average college freshman, must not bo applied to very superior 
students until they have been carefully validated on such a group. 
Even such iilaiisiblc conjectures ns that students with emotional 
disturbance will make poor use of their ability, are too simple to 
do justice to the true operation of personality structure. In one 
student, severe mnUuljustment may be a factor causing him to 
concentrnlc and earn high grades, whereas equally severe malad¬ 
justment of ft dilTeront character may impede tho work of another 
student. Clinical study of Rorschach protocols may con¬ 
ceivably reveal such interactiona. Even if the lost is not useful 
as a statisticftl predictor, it may help the psychologically-trained 
counselor to guide sludonts. 

Further research with tlic Group Rorschach is recommended, 
particularly since llio lilenvUn’o is still devoid of controlled studies 
on ndoquiito samples in typical college programs. It is urged 
that such sLudi«;.s inquire what elomeuLs or patberna in the 
Rorschach are associated with particular behaviors and criteria, 
rather tlian aLLompling blind prediction of marks or over-all 
ratings. 
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A NOTE ON THE EVALUATION OF COLLEGE 
llEMEDIAL READING COURSES 

H, A. ROBINSON 
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I 

Any investigator embarking on a sin-vey of the extensive pro¬ 
fessional literature in the field of group remediation, cannot fail 
to note a striking lack of adequate validation data, particularly 
at the college level. A number of reports of experimental course 
findings may be uncovered in the several journals, but the stand¬ 
ards of comparison used when remedial work is evaluated arc, 
more often than not, specious, ill-considered, or clearly super¬ 
ficial. This is peculiarly true in the field of remedial reading. A 
review of nearly one hundred studies, for example, uncovers less 
than a dozen references to the effect of reading programs upon 
scholastic improvement. Of these only one study using control 
groups reports apparently significant gains in terras of academic 
gratJps foj' reading chisses,® OUiw invesUgntors either report no 
significant improvement in academic standing as the result of 
remedial instruction, or without definitive findings take the 
hopeful and confident stand that reading instruction can improve 
academic work. 

This startling—and at the same time rather depressing—state 
of affnir.s poses a basic question for educators and research work¬ 
ers interested in college remedial reading. It would appear, even 
at this late stage of the game, that the cfTectivencss of reading 
programs is still largely suspect. Why is it that reading experts 
have bypassed what is seemingly a primary criterion for the 
evaluation of remedial instruction? Academic performance is 
clearly llic sine qua non for the validation of remedial, courses, 
particularly in libeml arts cuiTicula where l)y far the largest por¬ 
tion of the suholasLic agenda comprises reading or related aelivi- 
tioB. And in the final analysis remedial instruction must 
necessarily stand or fall on the basis of this single criterion, how¬ 
ever ingeniously alternative standards of comparison are defended. 

83 
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In apeculating about the rensonB for Ihia conHistont tlofeclion 
the tentative explanations which come to mind, plauHil)lo though 
they be, do not diagaiHC the fact that remedial U‘n(!hnr8 (or, more 
properly, those people Mdio concern themselves with tiic dovclop- 
mont of tochniques and programs) avoid meeting the issue scpiarely 
when they skirt the problem of relating rcHults to the weil-delined 
life situation in which they operate, or concern thoniHelvcs with 
other less meaningful vaines. It i« ccrtaifily true, for example, 
that a simple dcmoiiHtrftlion of increased aeiulemiccfftictivcness as 
a result of group remedial instruction in not easy lonrrangc;undcr 
certain circiimslandea it may be wcU-nIgh impOHsiblo. Most 
remedial reading couraes carry no academic credit, and are of 
relatively brief duration. It may bo that inslruelors are hesitant 
in their own convictions that a classroont hjarning experience of 
less, generally, than twenty-five class hours can have an observa¬ 
ble effect upon overall academic perfornuince, and flo beg the 
issue by emphasizing simple gains in reading Hjreed, incrcaso 
reported in outside or non-academic reading, and the like. This 
in fact is an ostrieli-liko behavior which lina had an inevitably 
unwholesome elTcct upon Iho development of wortli-wliilo 
remedial techniques. 

It is the usual oxporicnec in group reading instruction that 
marked and statistically significant gains in reading speed do 
occur, whatever methods or tcelmiquos arc applied. With his 
professional equanimity thus nsHured, the reading instructor may 
be loath to adventure into more imlicativo areas whovo less 
gratifying results would undermine the status and accc'ptability 
of the ijrogram. In certain cnvironmcnls tliis jnay eonceivably 
be a practical and immediate considcrnlion; in a broad view it is 
obviously short-siglitcd and deceptive. The fact is that tiro 
improvement of reading comprchciiBion and the development of 
basic organizational skills arc the core of the elialleiigcs which is 
posed to the remedial specialist. Thc.so abilities are complex 
skills which are accepted as being moro closely related to basic 
intellectual endowment than the ability to nnid rairidly; accord¬ 
ingly, they are moro difficult to revamp. Y(;t improved tli(;y 
must be, and with a demonstration that is convincing and 
stripped of idle embellishment. 

It seems reasonable to wonder whether remedial teachers at 
the college level have an appropriate frame of roforcuco for their 
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woric. la the heart of the reading problem actually being 
approached? Are inadequate instructional methods being 
masked with a superficial show of improvement whicli is always 
conveniently at hand? Are the rfilea of mechanical instruments 
and techniques being overplayed? Many remedial devices have 
a positive value—though their virtues arc neither cardinal nor 
unlimited—and they arc almost invariably effective for sustaining 
interest and motivation. Yet one suspects that because of their 
sheer and convincing mechanical facility, reading devices in the 
hands of somo instructors are invested with the large burden of 
responsibility for reading improvement, and become an end in 
themselves rather than a limited accessory or handmaiden in the 
basic problems of reading improvement. 

As for currently available remedial texts at the college level, no 
particular professional acuity is required to penetrate the super¬ 
ficiality of the types of exercises and treatments whicli charac¬ 
terize most of these volumes. The shallowness and malfunction¬ 
ing of college reading programs at large is reflected (and at the 
same time reinforced) by the patent over-concern for a simple 
increase in reading speed, by the plethora of timed selections for 
the measurement of speed with no more than a passing regard for 
well-grounded index of comprehension, by the relative absence of 
working materials to develop }>nsic organizational skills, and by 
the fetish usually made of a ‘high level of interest,’ which has 
produced a spate of materials and workbooks on a level of diffi¬ 
culty utterly impertinent to the task at hand. The continued 
demand of college educators for sound remedial work is made 
clear by the interest ami support given the corrective programs 
which do exist; Llic fallibility of the programs themselves is 
reflected unhappily in the potboiling welter of generally inconse¬ 
quential writing wJiich decorates the bookshelves of I'emedial 
specialists and instructors. Put diffomntly, there is some doubt 
as to whether tlio contemporary mass of study aids, workbooks, 
and corrective pamphlets in this area is really related to the prob¬ 
lem of improving reading skills at the college level. 

Ah a calltu!liv() result of these elements, the status of group 
remediation in (lollego eonliniies to l)c unhealthy. Remedial 
woric is still poripluu'al; remedial measures (and remedial special¬ 
ists) arc still under some suspicion. Integration of reading pro¬ 
grams with the curriculum is tenuous if attempted at all. Stu- 
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d<iTvta vcaditift ddCiculUca arc Kqw La uupiovG tKcic 

scores on staiulardizcd roiuling tcsls, but tivo nsHisLcd lo a far 
lossor extent in their l)ii8ie of iiondomir. adjuatment. 

Faculty cooperation leivvoa mucli to bo cleaired, allliougli some 
recognition and tonguc-in-c)ioek aeeeplance is given in many 
universities. And the nniding prograniH IhoniKolve.s to varying 
degrees are lacldiig iu vitality, force, pertineiua.*, direction. 
Why? ]3aaically the reason is that remedial programs linve not 
conclusively demonstrated tlicir worth. In tlie eyes of (aluciilors 
at largo this Hituntion not only castH a manllo of doubt over Iho 
field of reading and tlio educational p.syeliologists wlio arc working 
in it, but as a matter of courstj it also luus a systeinaLieally bad 
effect upon the life forces of remedial leseareli. For it is of the 
nature of tilings that patent sterility in any educational held 
attracts neitlier the most capable of researcli workers nor the 
most ofCoctwo and inlovostcd of instrwotova. 

In gauging the valiie of llicir (!las.s work, remedial reading 
instructors in the past two decades luivo gone through a kind of 
developmental scale which may be sharply criticized at every 
stage. The first typo of evaluation involved the simple and 
informal Hubjeclivo appraisal of result l)y eillun' teaeh(‘r or stu¬ 
dent, or both. However indofensiblo tliis procedure* from the 
standpoint of research accuracy, there is a deal of uu(l<miuble 
value in the sense that student and teac.hei- were reasonably 
united in purpose. In verbalizing subjective rea(!ti()nH lo a com¬ 
mon experience—participation in a remedial class - the parties 
involved were compelled to express a frame of reference. And if 
points of view dilTercd, they emerged and witn? immediately 
recognized—a condition by no moans clmracteristie of more 
'refined' evaluations. 

A second step hi appraising the rcsiiits of rOTnediid ivorii ivas 
the classical and overworked test method, wlicrein alternate 
equated forms of a standardized reading test were admini.stcrcd 
before and after the training period. Standardized and objec¬ 
tive reading testa with equated forms exist in large (luanliLics, 
and icst-rotost results show statistically significant gains witli 
gratifying regularity. This approach is useful only lo the extojit 
that a reading index or test score is a valid incaHUro of the com¬ 
plexity of reading skills which a college student needs for a suc¬ 
cessful academic adjustment—a highly dubious assumption. 
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Actually, this type of appraisal docs no more than demonstrate 
that remedial techniques may effect appreciable gains in ‘reading 
test performance.' Aside from the basic artificiality of the pro¬ 
cedure, there is a real danger that the organization of reading 
course materials will be directed to a perverted end, the improve¬ 
ment of rending test scores. Not only is the desirability of a 
meaningful transfer of acquired skills to an academic situation lost 
sight of, but in addition an insidious concept may be implanted 
in the mind of the participating student, who tends to acquire a 
false sy.stem of values with respect to his own reading abilities 
and skills. 

A third stage of evaluation sets a comparison between groups 
of individuals given remedial training and comparable unexposed 
groups, in terms of standard tests or other measures. The intro¬ 
duction of so-called control groups is an artful salaam to scientific 
method, but at bottom this proces.<j is as unreal as either of the 
foregoing. It must be noted, liowcvcr, that a leveling and 
leavoning induoiicc here docs take place, since it is a common 
exporionce that Clio ‘control' groups, given no remedial training, 
often show considerable gains—though not as great as those of 
the remedial groups themselves. The simple passage of academic 
time (or, more properly, the accumulation of certain environ¬ 
mental skills) appears to account for some' improvement' on the 
basis of reading test-rclcst rcsiills. And, of course, for the 
thoughtful and conacientious remedial specialist the real question 
remains: Do rending tests measure the sort of thing he is attempt¬ 
ing to improve? 

Apparently the last step in the appraisal of reading courses 
(and this touched upon with unbecoming lightness in the litera¬ 
ture) is the comparison of reading groui)s with suitably controlled 
non-participants, on the basis of academic performance. In these 
studies, reading class members arc generally matched with other 
Btudonts for reading skill (test scores) and a measure of intellec¬ 
tual capacity. A comparison is then drawn between the two 
groups, in terms either of over-all scholastic pcrformancG or a 
8 uilal)lc din’ivative (average grades in courses requiring heavy 
reading asHiguments, for example). With exceedingly rare 
exceptions tliese studies do not result in unequivocal conclusions, 
Diffei’cnccs between groups occur, and most often in favor of the 
remedial classes, but they cannot be defended on statistical 
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grounds. This fact of itself may in part account for the infre¬ 
quency of this kind of observation. 

Of the approaches which have been briefly noted iicrc, the lost 
appears to be the most defensible. The standard of comparison 
is meaningful and real both for in.slructor tuul student; goals of 
inatruclion aro necessarily wolUdefiiMMi in terms having an intense 
and practical value for an academic life-Hituation—st) obliging 
the instructor to discard iiTelovancies in organiy/ing his inaterial; 
the pitfalls intrinsic to the use of losls iiixs avoided. All this 
notwithstanding, there up])ears to ho one all-important objection 
to this cvaUiniive approach. The unsound assumption is made 
that requirements of G^'pcrimental control arc satisfied if initial 
reading performance and inlcllcclual capacity are held constant. 
That is to say, the proposition is made tluit there aro no other 
important qualities which may distinguish sUuhuitH in remedial 
courses from those who do not participate. Initial attiUide.s and 
motivations are entirely disregarded; a singular omission and one 
which becomes all the more striking wlicn it is remembered that 
most remedial classes aro conducted on n voluntary basis, or at 
beat have only partial aendemiu credit. AYhen Htudenls ehoogo 
freely to present thomsolves for remediation, or are allowed a 
degree of choice in selection, tlio function of ptu’sonality factors 
cannot in reason be denied. With a eertaiu logic ^>ne could 
theorize, for example, that under tho.se conditionH reading course 
registrants might bo overweighted with highly motivated indi¬ 
viduals—the undergraduate ‘eager lieavors’—whose (ivontual 
performance gain would be associated, at least in part, with the 
qualities and traits which caused the selection of the course in the 
first place. 


II 

Why do students present themselvca for remedial help? To 
throw some light on this question an informal 8urv{^y was under¬ 
taken in the spring of 1948 at the Department of Psyfilnatry and 
Mental Hygiene, Yale IJnivorsity, where a vomodial I’oading 
gram for undergraduates has been developed. Tho Rul)jocLs 
comprised sixty freshmen in Yale Collcgo, a random sample of a 
larger group who had paxticipatod in reading classoa during either 
their first or second semestei-s. The procedures were simple and 
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straigUtforward, including the group administration of a brief 
questionnaire designed for the purpose, and a half-hour indi¬ 
vidual clinical interview. The stated goal of this exploratory 
survey was to determine oa accurately as possible the motiva¬ 
tional patterns causative to ‘voluntary’ participation in remedial 
classes. Results were to a degree equivocal, and since the find¬ 
ings are subsidiary to the main issue of this note, a complete 
analysis will not be presented. Nonetheless, simply by way of 
illustrating tlie apparent complexity of student attitude facing 
the remedial teacher, there follows n brief summation: 

For each of the sixty men seen, it was possible (by an obiective 
tabulation of questionnaire responses and an evaluation of inter¬ 
view material) to assign a main determinant for the initial atti¬ 
tude toward remedial instruction. By no means entirely justi¬ 
fiable, this procedure tended to oversimplify the expressions, 
since often a primary attitude was scon to be contaminated or 
qualified by lessor dispositions. However, a substantial reliabil¬ 
ity was obtained in so rating these data for the principal attitude 
factor. Indopondont judgments made by two clinicians of both 
quosLionnairo responses and transcribed interview material 
resulted in perfect agreement in the selection of appropriate 
categories, and a percentage agreement of .93 in assigning sub- 
jeeta to the chosen categories (disagreements being referred to a 
third rater and a consensus obtained). It ahoiild be remembered 
that those students had given original lip service to the voluntary 
and non-acadcmic character of the remedial instruction. In a 
word, they had presented themselves as aware of certain reading 
deficiencies and de.sir!ng improvement. Accordingly, the atti¬ 
tudes recalled as important at that time might be considered 
substitutive, althoiigli in terms of motivation value—and con¬ 
comitant pedagogic challenge—they have been adjudged of pri¬ 
mary significance. The expressions of these subjects may be 
assigned to six general categories. 

1 ) For twenty-five individuals (little more than forty per cent 
of the grouvO, the main reason for seeking remedial instruction 
appeared to be a knowledge of a reading disability and a sincere 
desire to improve Hcholastic cfiicicncy tlirougli remedial work, 
In none of these cases was motivation markedly contaminated by 
other issues or values; these men were freely attempting to 
improve tlicir reading skills, uninvolvcd with social and emotional 
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pressures ubout this step, relatively imcoiiecrnocl with ihu self- 
devaluating judgmenta implied by their deeiaionH. 

2) In the case of fourteen Hludents the ])rimary reason for pnr- 
ticipatiou was a coercion (or a strong BUggesLion) on the* i)nrt of a 
dean, a student counselor, or a faculty nieiuhcT. Allliough their 
reading doficiencios were clearly denioiiHlrabU', llu*se iikui were 
without exception initially resistive to the idea of joining a special 
class and did ho only to satisfy an oflkdal injuncticHi, 

3) For eight studentR, the reading course appeared to repre¬ 
sent their last chance to remedy a variety of languagt' diHuniltics 
which had been unsuccessfully dealt with—in all cases through 
individual work—prior to coining to Yale. These subjects were 
handicapped by speech defeclH, or specific spelling disabilities, or 
deficiencies in Knglish usage, and while aware of tiie specific 
instructional goals, hopefully looked upon the course us being 
vaguely related to their own proldeins of language!. 

4) Declaration of candidacy for the remedial clasKcs was, for 
six students, admitted to he an overt and conscious avoi(lan(!(! of 
certain demands whicli the univcrHity ciiviromneut had made 
upon them, and which—in eacli ease hccuiiso of einotioual or 
personality prolficms—they felt unulilc to nuM't. In efTecit tlie 
remedial work was the Icssit of evils, a suhstilute activity. 
Thus, one student had been able briefly to extricate himself from 
compulsory physical training; another had parricil a i)iirtmlal 
pressure to take part in the nelivitics of a sUidcnl-Hponsored 
social service organization; still another was alU'uipling to ward 
off the stigma of a fraternity rejccliuii by nietlioilically entering 
all available campus activilicu, academic or otlier\\ is(!. 

5) In a somewhat different way than the foreg(MHg, tlie par¬ 
ticipation of four students appeared to relate directly to their 
inadequate and immature adjustment to the social and emotional 
requirements of a univereity atmosphere. Tliey felt no spcicilic 
anxiety or need; rather, an undifTcrenliated and <liiyuH(‘ concern 
for themselves and their work. Not markedly d(!lici(!nt in rc'ad- 
ing skills, tlioy were 'joiners,' uiicomfortabl<5 and iiici)!, intor(;st(!(l 
not so much in prestige values ns in being occupied, in this cu.se, in 
n situation which offered a possible ucudomic n'.ward. 

0) Lastly, the groupings above were not suited to tJ)rco men, 
whoso decision to take the reading course was for each a function 
of a basic personality maladjustment, and who were eventually 



Evaluation oj College Remedial Readmg Cowacs 

ssen at the Division of Psychiatry and Mental Hygiene as clinical 
cases. 

If they do no more, these observations serve to illuminate the 
source of some instructional problems in remedial work which are 
u.sually given little consideration in the evaluation of course 
results. They must in some way be treated if a realistic appraisal 
of remedial instruction is to be made. 

It is noteworthy that with this representative sample of volun- 
'teer remedial subjects, less than half was of an initial persuasion 
which would make for productive and efficient teaching, This 
note is inlcnded to suggest that the metlioda most often used to 
evaluate college remedial work are Indefensible to greater or 
lesser degrees, and that any reasonable appraisal must take into 
account the attitudes and motivations of the participating stu¬ 
dents. One possible approach to the problem of motivation con¬ 
trol is herewith oITercd in a brief account of a study conducted at 
Yale University. 


m 

An appraisal in terms of academic performance was made of 
remedial classes in reading conducted during the fall semester of 
1948. The control group comprised a number of students who 
originally presented thcmsclvcB aa candidates for participation 
and who were unable to do so through force of circumstance. 

As is the usual practise, a brief battery of reading tests was 
offered to all entering freshmen at the beginning of tho term, 
Results were reported to all men, and an announcement of the 
offering of a remedial course (to carry no academic credit) was 
sent to those individuals whose reading speed and comprehension 
scores fell below the 20Lh percentile. At the organization meet¬ 
ing of the course approximately one hundred sixty students 
appeared to (ill out a preliminary questionnaire pertaining to 
instruction, course detail, and sectioning. In view of the instruc¬ 
tional load it was necessary to limit sections and to arrange course 
meetings arihtrarily. Of the men who wished to register, sixty 
wove at that i.iinu unaliln to lake part because of conflicting 
academic scliedules or previous athletic commitments. The 
motivation toward the remedial work of those individuals who 
presonled themselves aa candidates and were in effect icjecLcd, is 
held to be at least roiiglily equivalent to the introductory motiva- 
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lion of actual participants. Tlius, if po.'iHiblo. dinfcTonces of 
intellectual ability and reading skill may bo coiitn/llcd, thoHc two 
groups offer an appropriate meniifl of gauging Uio elToct of 
remedial instruction on academic pcrfonnnnce. Tin; motivation 
of tlie non-piirticipants is, of course, uinlcr Homo H»iHpi(;ion; Hocm' 
ingly thesG men migiit have undertaken to traiiHfor to other 
soction meetings of academic courses, or to Haerilio(^ a purl of llioir 
athletic activity, in order to gain admiltunco. Tluit their 
interest in the remedial course was somewhat more Ilian transient, 
however, is attested by the fact that in a later Heinesler forty- 
three of those sUidenta (seventy-two per cent of tlie group) 
registered for the work. 

An initial comparison of partieipanls and iion-purlicipants in 
terms of two reading tost results, a rough measure of intelligence, 
and n combined index of college aptitude and socondury acliiove- 
raent, shows no marked group differences. Table I presents tlio 
mean scores for a measure of reading speed (words read per 
minute), a measure of reading comprehension, u general academic 
prediction, and the Verbal Section of the Colk'go Hoard Schohiatic 
Aptitude Test (SAT).* Contrived as an index of vorlial liom- 
prehonsion, the latter instrument is comparable to an index of 
(verbal) iulolligonco, and is often used a.*! sneh for puriiosea of 
general classification. 

The academic prediction scoros arc forccasls of average grade 
performance, and are derived l)oth from the 0.1').K.H. battery 
results and a suitably Weighted secondary school grade average. 
Since as cnfcoi'ing freshmen these aubjccls liavo no initial college 
grade standing, these predictions—combining aciulemic n])titiido 
and provioiis achievement—are particularly suitalilo an a stand¬ 
ard of comparison. 

Tho t values for these four measures show no significant dis- 

* Most of Iho wcll-kaoWD group reading tests have been jibniidoncd at 
Yalo, aincQ tlio larger part ol tlio iJopulaiion tends to array itself aear tlte 
uppor end of Iho scale, making prnclicnl diBcrinuiuilioiis iliirKadt. 'i'hc 
reading tests used in this inslanco were two long exiicrptH (IIOOO words) 
from basic history and psychology texts. Twenty iiacHlionH of a nuiltiplu- 
choico typo were devised for each eclcelion, and these tcHts, Htioied both for 
speed and comprehension, produced more Bnlisraotory distributions than 
published standardized instrumonls. Tho Scholnslio Aplitudii Test scoros, 
ns a part of the regular O.E.E.D. battery, were convenicnlly avnilnblo for 
oaoh subjeot, os wore also the oendomio predictions. 
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Table I.—Group Chahactehistics; Four Measures 



Remedial 
; Participants 
(N = 102) 

Non-Partici¬ 
pants 
(N = 60) 

I 

P% 


M 

<r 

M 

B 

■ 


Rending Speed 
(Words per 
Minute) 

230 

55.1 

238 

48.1 

.94 

30-40 

Reading Com¬ 
prehension 

13.G 

3.0 

13.2 

3.1 

.81 

40-50 

SAT 

538 

27 

629 

28 

.46 

60-70 

Academic 

Prediction 

71.3 ' 

6.3 

72.6 

7.0 

1.17 

20-30 


tinctrions ])Gi\vcGii Iho two groups. DifEerenccs which do exist 
may be attributod oillicr to numerically inadequate sampling or— 
as is more likely—to some real motivational disparity. The 
closest appi'oacli to a statistically defensible difference is observed 
with the academic predictions, where an index between the 20 and 
30 per cent confidence levels appears. Since these predictions 
are in part based upon a long-term scholastic performance, they 
are more likely to reflect motivation forces than the other three 
measures, derived from relatively brief tost situations. It is 
interesting to note that the non-participant control group sur¬ 
passes the remedial class members in two of the four measures. 
The control group displays a somewhat more rapid speed of 
reading, together with a slightly lower level of comprehension, 
than the experimental group. The mean aptitude test score is a 
little higher for the reading participants, who are at the same 
time assigned a somewhat lower average academic prediction. 
The combined Hignificance of these latter two observations is that 
of a better secondary school achievement on the part of the con¬ 
trol group, 

In each case the SAT mean is well above the general college 
average of 500 on tliis scale, and somewhat below the Yale aver¬ 
age of 550, Accordingly, this study centers upon a population 
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average or high average in acatlomic a]ititn(le (unlike tlio Inirdon 
of reading expenmenta reported in llio lilej'aUire, >v}iic)) liavo 
dealt with bclow-avcragc groups). Heading apeed and compre¬ 
hension RcorcH for l)olli groups ai)i)ro.xiiriatc Uie 25Lh percentile 
level for Yale froHhmen ])opulationH. 

The experimental group, disjoimal into i.lireo Heelions of 
approximately e(iuul Hiiso, was given twonly-one (dassrooiu houra 
of rcinediu! inalruetion. Tlie training period ex(('nde{i over ten 
weeks, and was comphded sliorLly before tlie (*nd of the half-year 
Homester. Scholastic records for tliis ueademie period were col¬ 
lected and comparisons drawn IjcLween the remedial group and 
the non-participants. The. two groups are contrasted in three 


TAnui CoMPAUiHON OP Aoadumk; Puupohmanok: 

HnMimiAP Studknth and Oonthods 



Remedial 

1 Participants 

Non-Parti¬ 

cipants 

1 

P% 

u I 

B 

M 

H 

Total grade Avorage 

72.4 

7.1 

B 

7.3 

1.4 


Verbal Courses 

73.0 

7.3 


(i.H 1 

1.0 

IBBal 

Residual Courses 

71.0 

fi.7 


7.fi I 

1.1 j 

20-30 


ways; in terms of over-all grade averages, performaiuie in (lourses 
of an essentially verbal nature, and porformainio in the rosidvnim 
of courses (largely scientific or quantitative!). The so-called 
verbal courses were arbitrarily selected to include those, areas of 
instruction in which reading skills seem basic to scliolastio suc¬ 
cess. The results of language courses (elementary or first-year 
classes excluded), and grades in I^conomitiH, J']nglish, Classical 
Civilisation, History and other social scieinio (iour.ses were! (!om- 
bined to a verbal average. The niiimining gnuh's -heavily 
laden with science course results but including all (ilementary 
language—wore also averaged. Tluiso data, with tlu! t values, 
are presented in Table II. 

By no means an unimpeachable proof of remedial cfl'cctivonoss, 
the results are nevertheless encouraging in view of Iho initial pre- 
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diction that the control group would to some extent surpass the 
remedial students academically. The scholastic differences 
shown are in favor of the remedial group and, in the case of verbal 
course averages, tho distinction verges closely on the 10 per cent 
level of confidence. To this extent participation is meaningfully 
associated with a higher academic efficiency. The least signifi¬ 
cant difference between the two groups appears, as might be 
expected, with performance in nonverbal eubjects. 

Inasmuch as these groups were originally seen, with the meas¬ 
ures used, to bo no more than roughly equivalent, the academic 
gain shown by the remedial students might be disputed. Accord¬ 
ingly a review of scholastic performance was also made in terms 
of carefully matched pairs of subjects. This procedure makes 
for an unavoidable sacrifice of population, but yields a near-per¬ 
fect equivalence beUveen a control and an experimental group. 
As many remedial students as possible were paired with non¬ 
participants on tlio basis of decile scores for the two reading 
measures and SAT results, and a three-point interval for the 
academic predictions. (In tlie latter case this arbitrary matching 
criterion was considered necessary because of the initial predic¬ 
tion disparity between the groups.) 

Application of those standards furnished thirty-one matched 
pairs of subjects. Conformation lictwcen control and experi¬ 
mental groups is satisfactory; tho I values for all four measures 
are smaller than .25 (less than an 80 per cent confidence level). 

An examination of semester academic averages for these pairs 
of students shows a mean difference, in favor of the remedial 
group, on the order of a 10 per cent significance (t = 1.7). 
Further scrutiny of paired differences in terms of verbal and 
quantitative course performance discloses very similar distinc¬ 
tions. Those resiiUs appear to bultresa the observations made 
with the larger populations. To the degree that the motivations 
of the two groups for remedial instruction are comparable, tho 
average gain of tho remedial students is at least suggestive of a 
veal academic utility. 


.SUMMARY 

1) A review of current remedial viractiaca at the college level 
reveals consistent sliortcomings with respect to the validation of 
techniques. Academic criteria have been generally disregarded 
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in tho evaluation of remedial work, and Oliver inelliods, fncilo but 
less relevant, employed to domonatralc aupposed improvement. 
Motivational factors involved in the Bludont ^(‘leetion of romedinl 
course work have been completely neglected in appraisals found 
in tho liLcrature. It is suggested tlmt tho unreal approaches to 
validation taken by remedial Kj)eeialiKlH have coniribuled in largo 
part to the still aml>igiiou8 and ill-delined professional hLuIuh of 
tho field as a whole. 

2) Hcsulfcs of a cojnidnod qijeslioniiairo-anil-intorviow survey 
of student attitude toward a non-credit and volunteer course in 
remedial reading arc reported. Initial motivation for the work 
ranged widely. Less than half of the group investigated dis¬ 
played original motivation which was eonMulorcd iiistructionally 
aclvautageous; the majority of students participated either 
through coercion or as a moans of avoiding certain environmental 
demands. 

3) In an evaluation of a claasroom remedial program l>y moans 
of scholastic performance, on attempt was made to take into 
account the initial motivation of piirtieipaling suhiects. Follow¬ 
ing tho training period Live remedial HtudentH showcul average 
academic gains approaching signilicanecv over Llu! control group. 
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TRUANCY AND CLASSROOM DISORDER 
AS SYMPTOMS OF PERSONALITY PROBLEMS^ 

FKANCES A. MtlLLEN^ 

Director, Bureau of Moiitally Handicapped Children, Chioago Public Schools 

It ia axiomatic in educational philoaophy that the child who 
lesorts to truancy from school or to disorderly behavior when in 
school does so because he is unhappy and unsuccessful in school. 
The reasons why he is unhappy and unsuccessful may besought in 
his physical condition and history, in his innate mental capacities, 
in his homo and community environment, or in the curriculum, 
teaching practices, and environment of his school. Any factor 
from one of these areas may be sufficient to produce a problem 
symptom; more likely several factors from several of the areas will 
bo found to contribute to a particular child’s behavior pattern. 

Granting these premises, the major questions to be raised by 
this paper are those: Are the children who turn to truancy as a 
solution for their problems different from those who choose class¬ 
room disorder? What physical, educational, personal, and 
social factors appear to bo more closely associated with truancy 
and which with disorderly behavior? Do these symptoms have 
a different constellation of associated factors for the adolescent 
child than for the pre-adolcsccnt child? 

The data for this study were compiled from the records of indi¬ 
vidual examinations of 1628 children, selected from the total of 
16,944 records of individual examinations made by psychologists 
and psychiatrists of the Bureau of Child Study of the Chicago 
Board of Education in the calendar years 1945 and 1946.^ To 
understand certain biases in the present data it is necessary to 
know more about the larger sample from which the 1628 cases 
were drawn. 

In 1945 tho staff of the Bureau administered 8262 individual 

* Paper read at Midwestern Psychological Association convention, 
St. Paul, Minnesota, May 7, 1918. 

* Formerly psychologiat, Bureau of Cluld Study, Board of Education, 
Chicago, 

* Munson, Grace. Bureau of Child Study and Ihe Chicago Plan of Adj^lsl• 
went Service. Chicago'. Boaril of Education, 1947, pp. 62. Contains a 
brief description of tlio work of tho Bureau and tho nature of tho exami¬ 
nations conducted. 
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examinations (not counting dicigiioHlic reading (‘xaminatioiis), 
and ill 194G, 8079.* Tlie mibjectB ranged from nursery school to 
college, witli intelligcnco quoUcnla from heimv 20 to above 200. 
Because no child may be placed in an ungraded division, or 
excused from school for m(*nlal immalurily, without the recom¬ 
mendation of the Bureau of Child Study, a large nuiubor of cases 
are referred to the Bureau hccauso tlie Hchnol personnel InOiovo it 
likely that the child is bolow average in int(‘llig(‘nco. Ilou'evcr, 
with Iho expansion of tlie Rlnff and services of the Bureau in the 
past twelve years, Bueli cases no longer pr<*(loininalo. Children 
arc referred for every variety of school proldein, including guid¬ 
ance of extremely gifted children, and Homelimes uL the request 
of parents or social agencies when no school prolilom has been 
apparent. This changed ompliasi.s in the work of the Bureau is 
rofloctccl in the increase of the mean iiitclligenco (piotiont of tho.so 
tested from 78 in 1037 to 88 in lOlG. Hoys have eonsistonlly 
predominated over girls in the ratio of about seven to thi'co. 
About onc-fourtli of nil co,scs in 19*15 and lO-lO wcu't; iion-wliilo. 
The present sample of 1628 cases incliide.s ehildnui from well over 
half of the throe luuidrcd seventy-nine cleimintary and high 
schools of the puldio school Bystem. Examinations l»y a large 
proportion of the seventy staff memhera are included. 

A Bureau of Child Study examination usually iucludf's an indi¬ 
vidual mental test, educational achievement tests, physical tests 
and observations, intevviewfl with parents, seliool pt'rsonnel, 
social agencies, truant ofRcers, physicians and clinies, and others. 
Cases arc cleared tlirough the Social Service 10xehang(* to deter¬ 
mine all agencies which have had contact witli the family. After 
an examination has been completed, the recommendations made, 
and the report written, many of the facts concerning the educa¬ 
tional, physical, social, and family history and condition of the 
child are coded according to a definite luimorieal system* by tlie 
psychologist. Then an IBM punched card is prepared for each 
child, giving the numerical results of mental and odueatiojial 
tests, and the coded data on other fnetorB. 

For the present study, the punched card r<?oords of all (ixamina- 

^Slaliatieal Report of Services of liweav of Child Study, BJ37 lOIfl, 
Mimoogrftplicd. pp. 63. 

* Revised Code for Child Study Record, January, 1015, Mimeograpliod. 

pp. 12. 
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tions made in 1945 and 1946 were sorted. The records of all 
children of ages nine to sixteen inclusive who were coded as having 
histories of truancy but were not conspicuously disorderly in class 
were placed in the ‘truant’ group, while the records of all chil¬ 
dren of the same ages who were considered notably disorderly but 
not truant formed the group labeled ‘discipline problem in the 
classroom.' Each group was subdivided into a group aged nine 
to twelve inclusive hereafter called the ‘pre-adolescent’ group 
and a group of thirteen- to sixteen-year-olds, hereafter called the 
‘adolescent’ group. Obviously this is an extremely loose use of 
the terra ‘adolescent,* employed here for economy of expression 
in referring to the two groups, as probably descriptive of a 
majority, though nob all, within the group. 

In the statistics which follow, these four groups: the pre- 
adolescont truants, pre-adolescent discipline problems, adolescent 
truants, and adolescent discipline problems, are compared with 
each other and with the whole range of child study oases for one 
year, 1940. This whole group is, of course, far from a representa- 
tivQ or random sampling of the school population. It is a group 
of children referred to an agency because they presented some 
type of problem in educational or social guidance. The truants 
and behavior problems here reported also are not necessarily 
representative of all truants or all the disorderly pupils in the 
school system, but only of those of the specified ages who were 
selected for referral to this agency. 

SEX, FAMILY ORIGIN, AND AGE RANGE OF EACH GROUP 

In the total group of all cases studied by the Bureau of Child 
Study in 1946, boys predominate over girls in the ratio of seven 
to three (Table I). In the two pre-adolescent groups here 
selected, they predominate in the ratio of about eighty-nine to 
eleven, suggesting at this age level a lesser tendency for girls to 
present these behavior problems than to present such other prob¬ 
lems as apparent mental or educational retardation, or other 
causes for referral to a clinic. However in the adolescent groups, 
a very dilTcrent situation may be noted, especially with reference 
to the truants. In the thirteen to sixteen ago group, almost forty 
per cent of th(5 caso-s included are girls. This probably reflects an 
actual increase in the incidence of truancy among older girls, but 
also reflects an added awareness on the part of the school per- 
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Table L—Deschu'tive Data CoNCEnNiNo the Four Giioupb 
OF Childhen Studied 



Pre-ndolc8ccnl 

Adolpsccnl 

1 

Children 

1 Kxamined 
in 1040 

N " 8070 


Truants 
N ■= 224 

Disciplinn 

ProblcJits 

in 

OlasHronin 
N » 511 

Truants 
N 002 

Discipline 

1 IVobiema 
in 

Classroom 
, N « 231 

Perconlnge of girls 
in tho group. 

11.2 

12.1 

39.4 

10.0 

i“ 

20.8 

Porccnlngo of non- 
whitedin the group 

37.1 

28.8 

30.4 

10.9 

23.1 

Mean CA in yeara 
and months. 

11-3 

11-0 

14-11 

14-0 

11-1 

Grade expectancy 
corresponding to 
mean OA . 

0.3 

Q.O 

0.9 

0.5 

0.1 

Mean MA in years 
and months'*. 

iO-2 

1 

10-1 

13-8 

13-3 

t 

Grade expectancy 
corresponding to 
mean MA. 

6.2 

6.1 

8.8 

8.3 

t 

Mean actual grade 
placomont. 

4.fi 

D 

8.8 

8.2 

4.8 

Mean grade acoro 
on reading com¬ 
prehension tcatb. 

3.4 

■ 

0.4 

6.7 

t 


• Based on Hoviecd Stanford Bmcl, Wcchaler Bollovuo, or ollior indi¬ 
vidual mental teat. Data not availnblo for eleven to twenty per cejit of 
each group. For most of these, mcnlnl data frotn n previous individual 
examination would have been available in the child’s folder, 
t Bata not availnblo. 

t Baaed on atandardized rending teals administered by llio psychologiat. 
Such testa wore not ndministcred for from thirteen to thirty per cent of each 
group of coflGs, uaunlly boeauso recent tesla had been given by tho school or 
Bomotimes beenuBo tho child had no meoaurablo achiovoinonls, InehiHion 
of fluch ensos would bo more likoly to depress limn to raiso tho mean grade 
level. 
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Bonnel of the serious social implications frequently associated with 
truancy on the part of girls of this f^e. An adolescent girl truant 
is perhaps more likely to be referred to the Bureau of Child Study 
than an adolescent boy truant. 

The percentage of non-whites (Table I) is higher in the groups 
selected for study than in the total of all child study cases, with 
the exception of the group of adolescent discipline problems. In 
tire other three gi-oups, approximately thirty per cent, or more, 
of each group are non-white, as compai'ed with twenty-three per¬ 
cent of the total group. 

Less than two per cent of the children of any of our groups were 
foreign-born, but a wide vai*iety of ancestral backgrounds are 
indicated. Children of Jewish descent arc seldom found in the 
truant groups of this study, but much more often in the discipline 
problem groups. Children of Irish descent are more frequently 
found in the ti'uant group than in the disorderly group. The data 
on the other national stoclca do not indicate significant differences 
in the type of behavior symptom developed. 

The ages of the various groups have been only partiiilly con¬ 
trolled by the method of selection used. Since truancy as a 
school problem increases in prevalence with age, while classroom 
disorder apparently decreases as a significant factor in our series 
of case studies, our pro-adolescent truants have a higher mean 
CA than do the pre-adolescent discipline problems (though both 
were limited strictly to pupils of ages nino to twelve, inclusive). 
The same is true for the two adducent groups. 

MENTAL DATA 

The mean IQ’s of the four groups (Table II) range from 90.3 
for the pre-adoloscent truants to 96.1 for the adolescent truants, 
with all four groups including cases from below 60 to above 
150 IQ. 

Because of the still existing, though lessened, tendency of 
school personnel to refer to the Bureau psychologist chiefly 
children suspected of having IQ’s below 80 (while handling prob¬ 
lems of brighter children without the psychologist’s assistance) 
these means must not be interpreted as though they were means 
for all the truants or all the discipline problems of the system. 
All four of our problem groups have higher mean IQ’s than the 
whole range of Child Study cases. Certainly the mean IQ of 97 
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TaULK II. —Pi:nCI2NTAflE DiSTIUDUTION of iNTEl.I.IOENnE Qoo- 
TlBNTfl m Fou« Sbdectbd G«Oin’B of ('iiildiii.w 


Inlolligrnco 

CJuolient 

Pro-ftdoloHPpnL 

AdolcHcent 

All 

('liildicn 
Mximiiiusl 
ill 1910 

N - 8205* 

'rruanta 
N •= 221 

Discipline 

PrnblfunH 

in 

(3n.ssrooiii 

, N « SU 

Truiint.s 
N « G52 

1 )i.‘iri[>linv 
Problcjus 
in 

(■lu«Hrnoni 
N « 231 

Ilclow 60 


1 


■■ 

2.1 

60 to 60 

.•1 

1.0 

.2 


3.8 

00 to 09 

•1.0 

4.0 

5.1 

7.4 

9.1 

70 to 79 

15.2 

12.9 

10.0 

7.1 

17 2 

80 to 89 

23.7 

16.6 

18.0 

18.0 

17.9 

90 to 99 

20.3 

17.8 

18.0 

22,1 

10,1 

lOO to 109 

9,8 

M.l 

17.1 

10.4 

10,8 

no to 119 

6.‘1 

8.2 

12.2 

9.1 

0.2 

120 to 120 

2.7 


4.5 

0,1 

3.0 

130 to 130 

.4 

mSm 

3.3 

3.0 

1.3 

MO to 1‘19 

* . * • • 

.2 

,8 

.1 

.7 

J60 or over 

.‘1 

A 

.2 

,1 

.5 

Not loatedf 

11.0 

20.6 ' 

9.6 

13.0 

U.O 


99.0 

m 

100.1 

100.1 

100.0 

Moan IQt 

01.1 


97.0 

91.(1 

87.8 

S.D. 

M. 39 


17.0 

10.3 

20.5 


* CluUh'on given nucUomclric cxaininaliuns only liiivo Itceii (>\e]ncl(><i. 
t For most of tlicsc cluUircii, intclligoneo qiiolioiitH from nii c>arli(‘i' iriili' 
vldunl menial examination would bo available in the (‘ii.se foltb'r, but was 
not avnilnblo on tlic punched card record. 

X Calculnliuns of niuniia and standard dovialion.s arc Inised on Iho miinbci- 
of children for whom intelligence quolicnta were available. 


found for our group of adolescent iruaiils strongly HUgg<^Hts tluit 
a random sample of this classiflcatiou of child fur llio whole school 
system would show a mean of 100 or higher. Tlu; luig(i per- 
contago of children failing in tho 80 to 90 IC^ rang(‘H suggijnU 
the possible hypothesis that many of tliese (iliildri'ii, IxnuiUHti of 
their personality disUirbaiiccs, appeared to their own Uiiieluirs 
and principals ns being likely candidates for an ungiiuhnl divi.siou 
(below 80 IQ), whereas the pHycliologisl’s examination revealed 
that a dull mentality was not tho root of the problem. 
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When mental status is compared on the basis of mental age 
(Table I), it must be rcraembei’ed that in spite of the narrow range 
of age selection, the truants had higher average chronological 
ages than the discipline problems, within both the pre-adolescent 
and adolescent series. The differences in mean mental ages for 
the two types of behavior symptom are probably not statistically 
significant. 

TRUANCY VERSUS DISORDER IN THE PRE-ADOLESCENT YEARS 

As we survey Table III, we may first list the characteristics 
in which the truants show more serious problems than the 
discipline cases. Children of our younger truant group are more 
apt to come from broken homes than are the discipline cases 
(inoidoncG fifty-two per cent and thirty-one per cent, respec¬ 
tively). A parent or sibling is known to be delinquent for 8.6 
per cent of the truants and only 1.5 per cent of the discipline 
cases. More of the truants have a step-parent, more are in 
foster homes, and more arc from families on relief. Known 
instances of lying or stealing arc reported for 11.6 per cent of the 
truants and only 0.5 per cent of the discipline problems. The 
truants have had more checkered school careers in that they have 
changed schools more frequently and have had more periods of 
interrupted attendance, though they have not repeated grades 
any more frciiuciitly. 

Second, WG may note the characteristics in which the discipline 
oflscs .sho^r more serious problems than the truants, still confining 
our attention to the prc-adolcsccnt scries. The classroom disci¬ 
pline cases appear much more likely to bo described as nervous 
and hyperactive, as employing attention-getting devices, as 
showing aggressive, anti-social behavior, and as possessing poor 
work habits. These things are probably partly descriptions of 
what is meant by the classroom disorder. They are very infi-e- 
quently marlccd for the children who have records of truancy, 
but arc not definite discipline problems in the classroom. A 
larger per vimi of the discipline problems than of the truants of 
this age level are described as having unfavorable health his¬ 
tories, suggesting tlmt the 'pampered sickly child’ may be found 
in the dinapjinc group more /r«pjenlly than in tho iruant group 
or in tho whole range of child study cases. Also a lai’ger per 
cent of the discipline problems are tlic eldest child in their own 
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Table III. —PRncENTAaB Incidence of Cbutain FACTons as 
Cited in the Case IIisToutEE op Fouii Selected Giioups op 

Children 



Pre-ndoloflcoiit 

Adolcaront | 



Tr\mn{a 
N = 224 

Discipline 

Proliloiiin 

in 

Cla.ssrnoin 
N “ 611 

Tnmnlrt 
N « 002 

Discipliiio 

Problems 

in 

(^assrooin 
N = 231 

All 

Children 
ICxainined 
in 1010 

N » 8070 

Educaiioml 

Faclon 

Ilepoftlccl graclc or 
grades. 

04.3 

00.8 

63.0 

66.0 

30.0 

VAficd Hchool cx- 
pcriencc. 

67.0 

37.0 

40.0 

88.6 

24.1 

Intoriruplod allcnd- 
anco. 

34.4: 

20.7 

20.7 

10.0 

16.8 

Unsnilablo place- 
mont, now or 
earlier. 

7,0 

14.1 

6.1 

10.4 

10.4 

Reading disability.. 

20.8 

26.4 

1 0.8 

20.3 

II.3 

Skipped grade or 
grades. 

1.8 

— 

8.8 

0.0 

2.6 

After school activi- 
tiOB. 

3.0 1 


7.1 

0.0 

1.0 

More than one year ' 
over-ngo for grade j 
placements. 

45.6 

48.1 

35.6 

42.4 

30.3 

More than ono year 
undor-ago for 
grade placement. 

A 

.2 

1.6 

.4 

.4 

Physical Factors 
Dofoctive teeth.... 

48.7 

41.3 

43.4 

36.5 

37.3 

Defective vision.... 

20.6 

27.8 

34.9 

29.4 

20,0 

Ear, nose, or throat 
condition. 

20.1 

10.2 

17.8 

10.0 

10.1 

Speech (listurbanco. 

6.8 

6.0 

4.1 

0.0 


Dofoctivo hearing.. 

4.6 

3.1 

0.9 

6.0 


Unfavorable health 
liUtory. 

4.6 

U.O 

0.6 

O.l 

6,7 

Poor nutrition or 
goncrnl health. . . 

3.0 

6.3 

8,0 

10.0 

4,8 

Behamor and Per¬ 
sonality Factors 
Poor work habits.., 

14.8 

62.6 

26.1 

61.0 

10.0 

Nail-biting or 
thumb-BUoking.. 

. 6,8 

8.0 

13.1 

1 10.8 

7.0 
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Table III {Continued) 



Pre-adoleacent [ 

Adolescent | 

All 

Children 
Examined 
in 1946 

N - 8679 


Truants 
N = 224 

Discipline 

Problema 

in 

Classroom 
N « Bll 

Truants 
N = 662 

Discipline 

Probloms 

in 

Classroom 
N = 231 

Lack of Bclf-oonfi- 
dcncQ. 


8.0 

10.6 

13.4 

6.0 

Nervousness, liyper- 
aotivity. 


18.6 

7.6 

19.6 

6.6 

Sociai immaturity,. 


6.0 

5.9 

7.8 

6.1 

Aggressive, anti- 
Booial behavior... 


27.4 

5.0 

27.7 

8.5 

Attention-getting 
devices... 

4.0 

16.0 

3.6 

10.0 

2.4 

Habits of lying or 
stealing. 

11.Q 

6.6 

0.7 

4.8 

1.9 

Withdrawn, un¬ 
social nature. 

2.2 

2.9 

' 6.6 

4.8 

1.8 

Temper tantrums.. 

1.3 

3.3 

1.8 

6.1 

.7 

Foiition among 
Siblings 

Youngest clilld. 

24.0 

! 23.0 

25.2 1 

25.1 ' 

25.S 

Eldest child. 

13.4 

22.0 

23.7 1 

23.8 1 

21.2 

Only boy among 
girls, or reverse. . 

8.6 

16.6 

15.1 

20.8 

14.0 

Only child. 

12.5 

15.7 

10.0 

12.1 

10.8 

Sibling rivalry. 

2,7 

3.8 

4.7 

0.6 

1,4 

Family Factors 
Broken homo. 

62.7 

31.4 

48.6 

37.7 

24.9 

Foreign language 
used predomi¬ 
nantly in home... 

13.4 

14.2 

11.6 

11.7 

12.7 

Step-parent in 
home, now or for¬ 
merly . 

16.2 

11.6 

16.3 

13.0 

7.2 

Crowded homo. 

1.8 

10.6 

10.0 

7.4 

7.2 

Unwise parental di¬ 
rection. 

21.0 

18.0 

27.9 

27.7 

6.9 

Foster or boarding 
homo placemout, 

0.4 

6.4 

0.0 

6.1 

4.4 

Inadequate paront. 

11.2 

8.4 

12.7 

14.7 

3.9 

Family on rolie/.... 

0.7 

4.2 

0.8 

4.3 

2.7 

Parent or sibling de¬ 
linquent or crimi¬ 
nal. 

8.5 

l.B 

6.2 

2,6 

1.2 

Insanity in family., 

1.3 

1.3 

2.4 

3.0 
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family, or are an only cliikl, or arc Uio only boy among gii'ls or 
the only girl among boys, than ia true for Llio Iruunla. How¬ 
ever, the inciclenco of Lhoac ‘posilion-in-family' facLora in the 
discipline group is practically the auine as in tlio whole range of 
child-atudy cases, whereas the ineiilene.e among truants is 
d<?finitely sinalh'r, HUggcfiLing tlic hypolheHiH that aueh lyp(!S of 
family position do not ho much conlrilmto to tlie develupiiuMit of 
behavior disorders tts they mililulc against development of 
truancy. 

Third, wc may list the. charactnrislicH of equal incidence in 
both groups. A wide variety of physical handicaps are reported 
for all these children. The two groups do not vary signilicaiiLly 
from each oilier or from the whole range of child-study eases in 
fcliG incidence of Hpccific typfi.s of physical defect, oxecpl in the 
general item ‘unfavorable health history,’ already noted. As to 
educational factors, over sixty per cent of both gron])K liavc 
repeated one or more haU-gradcs, and over forty p(‘r cent are at 
lea.st a year retarded in present grade placement, as compared 
wiili the normal grade plucemont for their chronological agc.s. 
Considering only the pttpils given nchiovemont tests by the 
psychologist, tlio groups have median reading-comprolKuision 
grade-acliicvcmont senres of 3.2 and 3.4, rcspeclivijly, and median 
arithmetic .scores of 3.0 and 4.1 (nots)iown in tlio tables), tliongli 
they arc actually in median grade placement of iJ) and 4.7, 
and liave apparently median mental capacity for academic work 
at 5.2 and 4.8 grade levels. In other words, liolli groiqi.s tend 
to he working more than a year below their actual grade place¬ 
ment in reading and more than a half-year below in arithmetic. 
If their achievement ia compared not with their ac.tual gi’ado 
placement, but with their mental capacity, the deviations are 
even more serious. As to social and family factors, aliou t twenty 
per cent of both groups of childi'on arc reported to have unwi.se 
parental direction (about three times as largo a percentage as 
for the whole range of child-study cases) and in about ten piu* 
cent of both groups the parents are described as 'inudequate,' 
meaning that there is ovklonce in the ease liistory of drunkenness, 
drug addiction, feeblc-mindadncss, ignorance, etc. Actual 
known insanity in Llio family is reported rallior infi'miimnUy, 
and equally for both groups. A foreign language is used in 
about fourteen per cent of the homes of bolli groups, but tliis is 
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about the same as the percentage for the whole range of child’ 
study cases. 


ADOLESCENT SERIES 

When the adolescent truants are compared with the adolescent 
behavior problems, very similar relationships are found. The 
truants more frequently come from broken homes, more fre¬ 
quently from families on relief, or from families in which a parent 
or sibling is known to be delinquent. They have had more 
interrupted attendance at school, they show twice as great an 
incidence of lying or stealing. Factors more frequently associ¬ 
ated with truancy than with dassroom disorder at the adolescent 
level, which did not appear as significant differences at tlie pre¬ 
adolescent level, include nail-biting, lack of sclf-confidence, and 
inadequate recreational provisions. 

When we look for characteristics which appear more serious 
among the ‘classroom disoider’ cases than among the truants, 
the same factors of nervousness, hyperactivity, poor work habits, 
aggressive anti-social behavior, and temper tantrums, mentioned 
for the pre-adolescent years, are found. There is still at this 
age a slight tendency for the only child or the only boy among 
girls or only girl among boys to show more discipline problems 
than truancy. However, the facts of being an eldest child, or of 
having a step parent, or being in a foster home no longer show 
significant differences of incidence between the two groups. In 
the area of educational factoi's, at the adolescent level, the 
discipline cases show more over-ageness, more discrepancy 
between grade placement and age, more reading disability, and 
slightly lower IQ (means 96.1 and 93.6, respectively). In this 
respect it should be noted that grade retardation and achievement 
deviations are apparently not as serious for the adolescent as 
for the pre-adolescent gi’oups. 

COMPARISON OF TRUAN'r DOTS AND TRUANT GIRLS WITHIN THE 
ADOLESCENT GROUP 

Because of the increased percentage of girls within the adoles¬ 
cent truant group as compared wdth the other three groups of 
our main study, the girls and boys within this adolescent truant 
group were studied separately (there being four hundred one 
boys and two hundred sixty-one girls), to see whether any 
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of the cliarftctcristics previously noted for the adolescent truant 
group should be conmdered primarily in ICirmH of a different 
BOX composition. The outstanding result of tliis breakdown was 
tho very sliglit difference in porcentagG of incidence of most of 
the factors, between these particular boys and girls. Con¬ 
sequently the complete tables arc not presented licre. Larger 
percentages of the boya than of tho giria were reported us having 
witliclrawn, unsocial nuturca (6.7 per cent to .‘h8 per cent); more 
of them also allowed aggressive, antiBocial behavior (0.5 per cent 
to 3.7 per cent); and more had speech ilisturliunecs (6,2 per 
cent to 2.3 per cent). In the realm of family factors, larger 
percentages of the girls came from families on relief, from crowded 
homes, from foster homcfl, and from homes -whore a parent or aib 
was known to be dcliiiqueut, while amnller percentage.^ of the 
girls than of the boya came from foreign-speaking homos. Tho 
first set of facts is consiatent with the rather widely hypothecated 
concept that boys show a wider range of behavior symptoms 
(from withdrawal to agres-sion) limn do girls; the second, with the 
oxpcrienco of school people that a more serious constellation of 
homo and school and pcraonalily difTiculUcs must develop to 
load a girl into an overt departure from conventional behavior. 

SUfilMARY 

The ohildren of our series of cases who have liistoriea of school 
truancy or of conspicuous class-room disorder have been shown to 
be children with a high incidence of other factors. Tlicy have 
many physical handicaps (virion, hearing, tcetli, etc.) though 
perhaps not more so than children presenting other types of 
school problems, such as retardation, lack of ability ole., who 
have not developed conspicuous behavior deviations. They 
have, however, had more erratic school liistorics than these other 
children who have been referred to tho Bureau of t3\ild Study, 
they come from homes prcHcntiiig many more social uiul family 
problems, and they show poorer poraomd adjustment. Both 
types of children suffor extromo educational retardation iis to 
grade placement, and oven more as to aclncvemcnt in llic l>a.9io 
skill subjeots. To what extent this rolardation is eauHC and to 
what extent it is effect of the behavior problems it is, of courso, 
impossible to say from such data as the present. 
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In general, children who choose truancy rather than classroom 
disorder as a method of escape from the tensions of the school 
situations have more home prohlcnm; crowded homes^ broken 
homes, families on reli^, parents or siblings delinquent of 
criminal; step-parents in the home, or foster-home placement. 
Such factors are particularly apparent among adolescent girl3 
who are truant. 

In adolescence, grade retardation and reading disabili ty appear 
more prevalent among the pupils who have become conduct 
problems in the classroom than among those who have become 
truant. 

In our sample of cases, both types of behavior symptom are 
associated with more serious educational problems (grade 
retardation and achievement deviation) in the younger group, 
and with more serious home and social problems in the older 
group. 

There is some evidence that at the younger ages the fact of 
being the eldest of several children, or the only boy among girls, 
or only girls among boys, or only child, militates against the 
development of truancy but not against behavior disorders in the 
classroom. This effect of position in the family appears to be 
much lessened if not lost by the time the child becomes adolescent. 



li'A.CTOHS IN STATE CIIAIIACTEUISTICS 
EEIATED TO AVlCUAGE A-lS V-12 TEST SCOllES' 


K. S. DAVKNPOUT and 11. II. llKMMTCnS* 

Purdue UidverHity 

Tlic A-12 y-I2 q\u\lifying examination dowu-ihed hero was tlio 
first one ftiven for Hie purpose of aelecliiig a (luotii, for iilaeeincut 
in tlie eollego tmining jirograms of Hie two services. It was 
given in April, 1913, to more than 300,000 young men, cither in 
liigli fichools or colleges, and wn-s prohahly tlie most e.xtcnsivo 
single day’s testing with a single teat ever lield in this country. 

The test wa.s composed of verbal, mathenuitical and scientific 
items, and the scores had a close relulionHlu]) with scores on the 
Army General Classification Test, (fon.sequcntiy, the lest could 
perhaps lie considered as a combinalion <if fi group ‘iiitclligoncc’ 
teat and a general educational achievement test. 

It seemed that llic stale mcauH could give a rougli imlication 
of some sort of cducalioniil level of lh« various slat(*H. In a 
previous paper* the writer reported high corrclatioiiH between 
these state means and certain educational finance data, for 
example, 4-.80 with current per pupil expomlilurcs. 

As a result of those data it seemed worth while to oliLain the 
relationsliips between this le.yt and otljcr sociological, economic, 
and educational data. Table I indicates llic iiaUin^ of the 
variables and the sixe of the correlations, 'i'lio varialihf.s were 
taUen from John Gunther’s Inside fAS.A. and give some indica¬ 
tion of the 'goodness of living’ of a state. Wlien the slate moans 
were correlated with other data, as shown in Talde I, it was 
evident tiiat certain other variables were either incasuring nearly 
the same tiling or were closely allied with the test imnins. Hinco 
there was only one measure of educational achievement, it was 

* A voi'tiion of UiIr paper was prcsonlod nl llio APA Oonvoation in Di^iivei', 
Seplembor 10, 10*10. 

*Thc aatlKiia winli to ocknowlcdKO llu* courtly of Hr. H. (Muuini'oy 
in allowint; them to viro tho A-12 V-12 dtiln aiul Mins horn Kiiminern nnd 
Mr. Pivul llftlan' for agisting in pro(!(‘.<i.sing Ll»o ilnlft i)rem‘iUi!(l liere. 

® Davenport, K. S,, and UeimnorH, II. II. "Kihiealioiml A<!liieviunent as 
Compared ^Yitl\ Money Spent on ScIiooIb.” School amt 6'«c|■c^y, l‘J15, 
« 61:333-334. 
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Factors in State Characteristics, 
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posBiblc to deduce that such achievement might be accounted for, 
in large part, by other variables. Obviously it was not necessary 
to have thirteen separate variables to explain the correlations in 
Table I. A faclor ajinlysia Ihua secraed lo be a logical procedure. 

Certain difncultics, however, arose in making a factor analysis. 
It can ho seen that many of the correlations aro negative, and 


Tadlr II.— OmoiNAb Factoh Loadinob* 


Variable 

Factor 

1 

2 

3 

4 

1 

.930 

.140 

.204 

.047 

2 

.894 

,201 

.067 

-.007 

3 

.051 

-.460 

.300 

-.371 

4 

.700 

1 -.167 

-.050 

.190 

5 

.046 

-.000 

.238 

.209 

6 

1 .325 

-.490 

-.461 

1 -.301 

7 

.832 

-.488 

- .178 

-.124 

8 

.096 

.300 1 

-.271 

.120 

9 

.862 

-.133 

.071 

.125 

10 

.913 

.049 

.185 

.040 

11 

.490 

.601 

-.105 

.207 

12 

.776 

.342 

-.273 

-.316 

13 

.867 

.238 

.190 

-.101 


* Variables 4, 7,0, 11 roflccted from original matrix (Table I) 


some highly so. Tho typical factor analysis begins with a 
positive matrix; there was no reason, however, why tho original 
matrix should not have certain variables rcQeotcd before any 
factors wore extracted. Variables 4,7,9 and 11 were so reflected, 
thus giving an esBontially positive matrix. Kxlraction of the 
factors was then carried out by tho usual procedure, one addi¬ 
tional problem being recognissod. Since most of IhoBo data wore 
population data, tiiore was a problem in knowing tho size of tho 
residual which could bo accounted for in terms of ohaneo. Tho 
writers arbitrarily set a residual of .10 or smaller ns being a 
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chance residual; after exti'acting four factors the procedure was 
stopped since there were only two residuals of the size of .10—all 
others being less than .10. 

Table II gives the original factor loadings, with the notation 
that the variables which were rejected in the original matrix 
(Table I) were kept bo deliberately. Since these were logical 
reflections, one need merely reverse the meaning of the variables 
to make them clear. For example, variable 4, number of lynoh- 
ings per hundred thousand, when reflected, could be considered 
lack of lynchinga per hundred thousand, and variable 7 would be 
lack of Negroes per thousand. These reflections should be 
remembered during the subsequent discussion. 

As Table II is scanned, it can be seen that factor 1 has by far 
the heaviest loadings. The other three factors are much less 
highly saturated and perhaps arc of lesser importance than factor 1. 

Attempts were made to rotate the factors to meaningful struc- 
1111 * 6 , but, again, with all factors being essentially bi-polar, the 
typical procedure of maximizing on one factor and minimizing 
the negative loadings on the other factors proved to be relatively 
meaningless. A rotation to extract a ‘principal’ factor likewise 
proved to be of little value. Consequently the loadings were 
given a simple rotation through tho centroid, resulting in the 
factor loadings shown in Table III. It will be noted that veiy 
little change was made by rotation in any of tho factors, the 
greatest change coming in factor 4. After rotation, of the total 
contribution to the variance (sum of factor loadings squared), 
factor 1 contributes 72 per cent; factor 2, 34 per cent; factor 3, 
8 per cent; and factor 4, 6 per cent. 

•The name of the first factor was seemingly obvious, but the 
other factors proved to be much more difficult for extracting a 
general principle for naming based on their loadings. Factor 1 
is almost surely a state economic factor. Extremely high load¬ 
ings are shown for variables 1, 2, and 10, with these variables 
l)cing used frequently in determining a state's economic ranking. 
Loadings of .930, .894, and .913, respectively, for these factors 
(1, 2 and 10) indicate that these three variables are almost wholly 
measuring one thing. 

Factor 2, with high positive loadings on variable 11 (note that 
this variable has been reflected) and variables 8 and 12, and with 
high negative loadings on variables 3 and 7—7 being another 
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reflected varial)lo--f!cem to indiciilc Unit this is a rural-iirhiui 
axis, with rural on the ncRUlivc Bide and urban on the positive 
side. Slates that were high in pui4.ses.sion of lihruru'.s, in foreign- 
born, and in rosldcuts in Who'n Who ore proilominantly urban; 
while Blatca that have Uigli autoim)l>ilu rogihtrations and a low 
I>roportion of Negroes arc prcduininanlly rural. 


TAiUiK III,-- I'actou fn)Ai)iN(;s akit.ii IIot.vi’io.n* 


Varial)lo 

Fucttir 

I 

2 

3 

’ 4 

1 

.030 

.130 

.202 

.080 

2 

.808 

.101 

.000 

-.035 

3 

.050 

~ .413 

.403 

-.353 

4 

.002 

-.170 

-.005 

,211 

f) 

.030 


.228 

.270 

« 

.330 


-.448 

-.208 

7 

.831 


-.180 

-.101 

8 

.004 


-.273 


9 

.840 

-.115 

.00! 

^■9 

10 

.912 

HU 

. 182 


11 

,403 


-.100 

.280 

12 

.780 


- .2()l 

- .281) 

13 

.805 

.230 

.107 

-.100 


* Variablna 4, 7, 0, 11 reAcclcd from origiiini matrix {Tul)Ii! I) 


The third factor cannot be definitely idenlifiofl, but it Ht'onis 
likely that it is a geographical factor, that is, u (hseii-Soiith 
versus non-South axis. For example, slules wliieh are higli in 
automobile rogielrations (variables), \Yilh a ptjsitive. .Ih)(i lojid- 
ing, are not in the South; wliilo slalOH witli a low proporlitsi of 
soldiers killed in World Wav 1, with a negatives .-15] loading 
(variable 6), are in the South. This lutlor fact may Ik^ iKHiounliul 
for, probably, in standards of selection and (»f soUUer ciiiiabililies. 
The other po.sitivo and negative loadings seem to support this 
tentative naming. 
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We have not yet named factor 4^we are unable to pick out 
what is left, for example, in variable 3, when income, urbanity, 
and geographiGal location have been accounted for. The same 
question arises when variables 11 and 5 are considered. This 
factor is undoubtedly important, for it has substantial loadings 
on ten of the thirteen variables, and has a 6 per cent contribution 
to the total 

As a final statistic, the multiple correlation between the cri¬ 
terion of the A-12 V"12 test means and variables 8, 6, 8 and 10 is 
.962, indicating that from these four variables one could predict 
with little error the standings of the individual states on the test 
means. ' 

Tl should be recognized that this test was given in 1943 and 
that there may have been great changes in the complexion of the 
states since then. It seems to the writers, however, that there 
is considerable food for thought in the results of the foregoing 
analysis; income is generally recognized as being a desideratum, 
if not a necessity, hut it has not been so frequently recognized 
that it is of snob major importance in educational achieve¬ 
ment. When it is considered that the factor loading on factor 1 
for the test is .857, that more than 70 per cent of tho contribution 
to this educational variable is that of income, then a state's 
income must be heavily weighted in discussion of state educa¬ 
tional achievement—if the hypothesis that this test is a reason¬ 
ably good measure of such achievement be accepted. 

These data are all state data; they do not apply to individuals, 
Without much facetiousness, however, we interpret these results 
to mean that the probabilities of reaching a high educational 
achievement are much greater if one comes from a high income 
state which ia highly urban, which is not in the South, and which 
has such advantages as library service available to most of its 
population, has a high proportion of foreign-born citizens, a large 
number of residents in Who’s Who, and many telephones. 



USE OF THE MINNESOTA MUT/riPHASIG 
PERSONALITY INVENTORY IN SCREENING 
COLLEGE STUDENTS FOR COUNSELING 
PURPOSES 

CJLP:NN H. IIAWKKS 
Utah Klaln AKriciiUtirnl (’olJrRO 
Ij<)Knn, Utah 

It Ima ))ccome apparont to college workers that many students 
fall short of realizring their full capuhililieH hneausn of lack of 
adjustment. To meet this condition, more and more colleges 
and universities are insUtut-iiig and d<!Vcloi)ing counseling 
aorvices. Because of the increased cost of such servicis and the 
extended time involved, it hns also become evident tluit any 
device which improves tlie cfUciency of connseling is highly 
desirable. Since the signs of latent personality di.slurhances 
and, in many cases, even cxiHiiug maladjuHlinent, are often not 
revealed in overt behavior, devices wlikli would aid (iounselors 
in selecting from a large population the individuals having prob¬ 
lems of personal and social adjustment or who are likely to 
develop these problems would be very uaefuh 

In, tins investigation, the Minnesota MultipluiHic Personality 
Inventory (MMPI), a device which ha.s been found valid in other 
situations,*'®'* is evaluated with the intent of (liscov(?ring how 
useful this inventory is in determining maladjustment in college 
life. Specifically, this study determines to what extent scores on 
this inventory earned by students when they enter college will 
bo predictive of maladjustment which may develop later in 
several aspeeta of college life. 

In an oITort to moasiiro the ability of the hlMPI to picdict as 
stated above, it was administered to the cnLoring frcHhinen at 
Utah State Agricultural College, Logan, Utah, for the school year 
1017-48. This group of u little over one thousand one hundred 
comprises the population from which the subjocts wore Hcloctcd. 

In order to derive data which could bo to.stod for statistical 
significance, the following general proccduro was used to select 
Bubjeeta for study ■. 

It was found that fifty-two male and eleven female subjects 

no 
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deviated two sigmas above the mean on the MMPI areas of 
Hypochondriasis, Depression, and Hysteria. These subjects 
were selected for an experimental group. Due to disqualifying 
validity scores, non-availability of subjects, withdrawal from 
school prior to the setting up of the problem, the group was 
reduced to twenty-nine males and eight females. 

This experimental group was matched subject for subject with 
twenty-nine males and eight females whose scores fell within the 
normal range as defined by the authors of the MMPI. Criteria 
for equating were as follows: same age, sex, class rank in college, 
and equivalent scores on the United States Armed Forces 
Institute tests of Effective Usage of English and Readings in 
Natural Science. Tests of significance of the equating scores 
revealed that the groups did not differ significantly. Such 
differences that wore found later, therefore, were attributed 
largely to differences related to areas of the MMPI. 

The selected subjects were then examined for differences in 
the following areas: (a) Interest, range and pattern, as revealed by 
the Kuder Preference Record, (b) Grade-point ratio for the 
academic year 1947-48, (c) Referrals to the Deans of the College 
for discipline, low scholarship, or commendation, (d) Ratings by 
faculty advisors using a rating scale, (e) withdrawals from school 
during the course of any quarter of academic work, (f) a single 
interview in order to determine social participation, objective in 
college study, overt manifestations of maladjustment, facility of 
expression, manner, etc. These areas were selected for three 
reasons: to the investigator it appeared plausible that students 
with personality disturbances might be expected to reveal their 
maladjustments in these ways. In at least one area (range of 
interests), previous research had indicated such areas as were 
studied were related to general maladjustment.'* Finally, data 
on adjustment in these areas were available to the investigator. 

The following procedure was established for deriving the data: 
The Kuder Preference Record which was administered in the 
battery given prior to registration was used to determine the 
fitness of the stated college objective. The stated college 
objective was determined in a single short interview. In deter¬ 
mining the fitness of the objective with measured interest, the 
present objective was compared with suggested occupations for 
specified interest patterns. The Kuder Preference Record 
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I^Ianual wiLli the suggested oeeupalions was used us Die criteiloii, 
Arbilrtvry numerical vahms woi’(5 assigiiccl b!is(‘(l on dcgice of 
filness. The rcsiiltH wore tabulated and tested for siguificunco. 
A critical ratio of 2.81, significant at the one per cent level, was 
found which indicates there is n Htutistieully signilieant dili'erence 
iHilvveeu the exporimenlal and eoiitnil gi*oup in the lihie.ss of tlieiv 
Helo(5tcil objective tus compared with interest patterns yielded 
by the Kiulor Pveforenee Vleeovd. 

On tlic basis of Berdie’s rcHoarch/ oin* miglit po.sLulate that 
the neurotic person's interest is relatively Hat wluui ])lotted 
vertically as opposed to the number of peaks shown for woll- 
acljufitcd individuals. The nine Kuder Prcfeience R(MH)i’d i)oi'- 
ccntilc scales were plotted on a Kudor pRyclHJgra[)h. Tluiy were 
then assigned a numerical value as they deviat(!d from tlic mean. 
This value increased at the rale of 1 point for cacli 5 percentile 
points. Values wore ruled ns p«.Hitivo in n(‘gativn or positive 
deviation, inasmuch us they indicate cither i)ositiv(i or negative 
peaks. Tlic type of peak was not thought to he significant. 
A total score for pcakness and flatness wn.s lliuH obt aim’ll. A 
critical ratio of .88 was yielded in comparing the exiH’fimcnlul 
and control groups. This is not sigriijicant Init indioiles a 
tendency in the direction indicated. 

At the time of the iiitorviow, both experimental and control 
subjects were questioned ns to their pre.sent (;oll(!ge oliji^clive, 
previous objective if changes had been made, and llioir plans for 
college objective made prior to entering school. Tlu; i'c.suUh of 
these questions were tlien lalmlatcd and given a immcriral value. 
It was hoped that such determination would indicalo the slability 
of the interests of the subject. Arbitrary numerical values were 
used in ascending order commensurate with tlui stability shown. 
The tabulated results of this phase showed no difiVri'iua-s, 

Adjustment to college life and the various demands made 
upon the individual by successful college work ur(? no doubt 
reflected in scholastic achievement. To subHlanliate Huh a clieiik 
of grade-point ratio was made, A critical ratio of 1.77 was 
yielded. This fails to ho significant at the five per eiuiL level 
but may indicalo a trend of lower scholaslio uclueveiiKinl foi' tlui 
experimental gvowp. 

It was stated in the hypothesis of the problem Llial maludjustod 
students would be referred to the deans most aCton for discipliiiG 
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or low scholarship, This premise was tested by contact with the 
deans and no significant differences between the number referred 
in the two groups was obtained. 

Inasmuch as the faculty advisors are most likely to have 
information about a student, they were contacted regarding the 
subjects. To facilitate this information gathering and in order 
to preserve as much objectivity as possible, a rating sheet was 
devised. This rating sheet is typical of inventories such as the 
Haggert5’--01sen-Wiclcman behavior scale. The raters were 
cautioned to preserve objectivity as far as possible. In deter¬ 
mination of statistical significance a critical ratio of 1.46 was 
yielded. This fails to reach statistical significance. 

In a check of the area of withdraw^ from college no statistical 
significance between, the two gi’oups was found. 

Another phase of the experiment was to conduct a short well- 
controlled interview with each of the subjects. An attempt was 
made to determine the extent of social participation of the sub¬ 
ject in the college and community. To preserve objectivity a 
random order of interviewing was selected and the experimenter 
was not aware whether the subject was experimental or control, 
The subject was asked about the extent of participation and then 
numerical values commensurate with this participation were 
assigned. A critical ratio of 2.53 was yielded which is significant 
at the five per cent level. This indicates that groups of better 
adjusted individuals participate more in social activities. 

In addition to vocational objective and stability of objective, 
and extent and nature of social participation, the subjects were 
rated on facility of expression, appeai'ance, attitude, and overt 
signs of maladjustment. Comparison of the group in this factor 
yielded a critical ratio of 1.69 which shows no significance but 
indicates a trend in favor of the conti'ol group. 

SUMMARY AND CONCLUSIONS 

A tabulation of all results is given in Table I which has been 
prepared in order to summarize and integrate the data presented. 
In two of the six instances, a significant critical ratio was found. 
The first hypothesis, that the control gi'oiip would select objec¬ 
tives more in keeping with tibeir measured interests, was con¬ 
firmed. The difference here was significant at the one per cent 
level. For the fifth hypothesis, that the control subjects partici- 
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pated more socially, a clifTcrence, Kigiiilicant at the five per cent 
level was found. Tlioro cxlata a real (liffcrcnco between the 
groups in tlicse two aroaa. The importance of tliose two areas 
to college adjusl.innnt, where the dilTereiiceH are significant, is 
indicated by Finch and Nomzek‘ amt l)y Hill® who concerned 
tlicmsolveH with social ufljualinont hecauw; of the weight attached 
to this olcincnt of college life. It also seoins to Iho writer that a 


Taulk I. — Tahulation of Uksui/i’h in thk Uhk of AIMl’I in 
S cjiniiNiNO ConLEOK Studenth fou CJoitn.semnq I'uuposes 


Area Measured 

Mci 

Kxp. 

iin 

Cout, 

(hit. 

Ratio 

Lovol 

of 

Rignif. 

Direct. 

. of 
Diff. 

Fitness of collcgo, objective 
compared with Kuder Pref- 
eroiico llceord 

3,10 

3.72 

2.81 

.01 

Clout, 

Feakuesa and fiatness of inter¬ 
ests as revealed by Kudor 
Preference Uccord 

53.41 

55.41 

.88 

Not 

CJont. 

Grade-point ratio 

1.25 

1.74 

1.77 

Nut 

Oont. 

Numerical values of rating 
scales 

20.20' 

10.01 

i.40 

Not 

Gont. 

Numerical values of social par¬ 
ticipation 

79.04 

84.32 

2.53 

.05 

Oont. 

Numerical values of social im¬ 
pression 

20.91 

22.04 

1.09 

Not 

Cont, 


properly selected vocational objective which is closely related 
to the sbudonVs interosls will assist him in adjustment to the 
college situation. 

In tlie roinaiiiing four ureas wlierc ditTercnces were coinputed, 
it was found that the dirfcrcnco in each ease failed to veatil* statis¬ 
tical signifienneo. It should bo noted, ])owev(5r, that the trend 
in all of the measures was in favor of the control gvouii. Fos- 
sibly, liad ofclior areas of study been selected, diffcrcncos in quality 
of adjustment might have been revealed more sharply. Failure 
to find differences of statistical significanco in certain areas does 
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not necessarily invalidate the device; it may lead one to question 
as to whether these checlm were appropriate. 

It seems ]u8fcifiable to conclude, then, that some differences 
between the groups exist and that this device will predict these 
differences in at least two important areas. This indicates the 
value of using the MMPI as a screening device for college counsel¬ 
ing. Students who are revealed by the device as maladjusted 
might well be assigned to an advisor skilled in personal adjust¬ 
ment counseling. This would more adequately utilize the serv¬ 
ices offered and make a guidance program more effective because 
stress is laid where it is apparently needed. Our results also 
indicate that the use of the device would not assure that all 
students in need of adjustment counseling would be detected, 
and that some students would be ^identified’ who are found later 
not to need such help. 
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Florknuk L. Ciooi)KNoi3«ii. Mmlal Tcslvvj: lia Ilhiory, Prin¬ 
ciples, and Applications. New York: Hitii'liurt luid Co., 
10413, PI). 000. 

Those wlio liiive {uliDirc’d uiul profilrd from (lie workH of Dr. 
Ooodonough Ihroui^ljoiit lier rareor will he dclij^hliMl tliuL hIio. 1ms 
produced tiiia volume.. In it she looks ul four (hicadcH of menial 
testing, lays huro llte issu«\s of moat iinp»rlane(‘, and evaluates 
the progVGBS that hua liecn made. Her eominoiils acepnre iiupaet 
l)oth from her wisdom ainl exporicnco, and from luu- no-non- 
senso style. Because this volume trie.s to cover all her view- 
points, the contoiils are extremely varied. There an; .sections on 
all typos of to.sting, iiieliidinfr motor dcYclopinenl, ratings of 
social bchavit)!', and projeelive le.sls us well as le.sls of tiie Biuet 
genre. Bccau.so slic c(|uates critical lliiiiking with .stati.stical 
thinking, llierc is a s(*rie.s of eliai)ler.s on sampling and Ktatistical 
methods through analysis of variaiic’c. S(!v<'ral concluding 
cliapLcrs, much less m<‘aty, survey the uw- of Lc.st.s in siihools, 
clinical practice, industry, social work, e.lc.. 

Goodeuough covers knotty prolilems of iru'nlal-Lcst theory 
which have litcw adw\v\aUdy rcHtated \u uu u\udcYu huok. T’\\cvg 
is, for example, n careful analy.sia of ll»c .scaling proccdure.s of 
Heinis, Woodrow and Arlliur, vuii Wagmum, and cjIIums. She 
makes considerable use of a pn»vocalive. distinction liotween 
tests as samplCvS of heJtavior, niul teat perfornuuice as a sign of 
traits. Another asset is u very satisfying history of early 
developments in testing. 

Comparatively little space is given to de.scribing tests or to 
citing evidence. In.stcad, Goodeuough presemts a personalized 
evaluation of ouch area. Often these eonimcnls ar(! (ui the 
devastating side; scarcely a chapter dealing with work after 
1910 is without such phrases us'Hlaiislinil illiterates,’ ‘insunicient 
eontrolB,' or 'bhiudevs and fatse eonehisioiiH.’ lh;v position is 
conservative, and ho will please .st)me naidcrs luon; than ollntrs. 
While she is oi^eu-ininded on projective tests, f()r (ixainpk;, slu; 
chooses to apiu’oacli them through u deliiilcsd consiiU'rution of 
Binet’s case studios of his dniiglitei's, and Mien is <puU* o.xpliiut 
that the moderns have lacked the insiglit and the Lccliniciue to do 
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as well as he in the same area. Some of her treatment is open to 
criticism. She recommends using vocational aptitude tests of 
the Minnesota variety in a way the reviewer considers insuf¬ 
ficiently critical. Her unqualified stress on the desirability of a 
normal distribution of teat scores disregards recent thinking 
about maximum discrimination. Her suggestion that reading 
readiness tests are to be used in deciding whom to admit to first- 
grade does not consider their use in planning a suitable school 
program for every six-year-old. 

While every reader will find something to disagree with in so 
uncompromising a book, no psy choogist or educator can come 
away from the book without fresh insiglits. It is particularly 
valuable to have attention drawn to some of the underlying 
problems and assumptions which are ignored when testing 
becomes a business or a technology. Because of Goodenough’s 
perspective and tough-mindedness, her book will make a distinct 
contribution to the education of the advanced student. 

Lee J . Cronbagh 

University of Illinois 


Alfred A. Strauss and Laura E. LsirriNEN. Psychopathology 
and Education of the Brain-Injured Child. New Yorki 
Grune & Stratton, 1947, pp. 206. 

Children physically handicapped or sound who show intel¬ 
lectual or personality aben’ations as a result of injury to the brain 
substance is what this book concei’ns itself with. Content, 
methods used and general approach toward working with brain- 
injured children described in this volume will be of distinct value 
to all people interested in the education of the brain-injured 
child. The volume has been -written by the president and the 
educational director of the Cove Schools for Brain-Injured 
Children at Racine, Wisconsin. The two authors have had 
nearly twenty years of experience in studying and working with 
these children, and they have learned much from those experi¬ 
ences. The book itself is divided into two parts. Eight chap¬ 
ters are devoted to psychopathology which composes Part I. 
Part 11 is composed of four chapters on the education of the 
brain-injured child. Also there is an appendix which includes an 
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unpublished essay on the bra-in-injured deaf cliiUl written by 
Mary Agnes Blair, references and an index. 

In general, this is an extremely well-done job. Tlie jjart on 
psychopathology is clear, concise, illuslrabivo, intelligible niul 
comprehensive. It includea chapters on iiistorical review of the 
literature, consideration of the anatomy of the brain and its 
function in the relationship to its foundnliona for considerations 
of some problems of the bitiin-injured child. Topics considered 
include perception and perceptual disturlianccs, tlnnking dis¬ 
orders, behavior disordei-s, testing the brain-injured cliiUl, clinic 
and diagnosis of brain injury on children, and the concept of the 
exogencous child versus the endogenous child. Tlie part on 
education includes consideration of general principles, and 
chapters on teaching of arithmetic fundamentals lo the brain- 
injured child, teaching reading, and teaching writing, lleporls 
of the results of their own studies and the evaluation of the con¬ 
tribution of such people as Kurt Goldstein and Doll are all well 
done. It is the most compact and comprehensive volume on 
this topic which has como to the attention of the reviewer. 

11. MBI/i’ZEU 

Psychological Service Center 

St. Louis, Missouri 

D. Snygq ani> a. W. Combs. Individual Behavior. Now York: 

PTarper and Brothers, 1949, pp. 386. 

This book presents “A New Frame of Kcfcrcnco for Psy¬ 
chology,” phenomenological psychology. “All behavior . . . 
is determined by . . . the phenomenal field of tho behaving 
organism,” not by objective reality, but by the situation as the 
organism perceives it. The task of understanding behavior is 
that of understanding or reconstructing tho behaver’s perceptual 
field. The task of predicting behavior becomes one of predicting 
how the behaver will percoive a situation at a future time; i.e., 
predicting hia phenomenal field. There arc two ingredients in 
the phenomenal field: tho field of objective reality and tho 
behaver himself—the 'phenomenal self.' Thus there are two 
ways open to changing behavioiv—changing the objeetivo fujld 
and changing the phenomenal self. Tins general idea is as old 
as Plerbart, at least; and except for Uio fact that ‘apporceptivo 
mass’ is much leas dynamic, that term might be substituted for 
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‘phenomenal self.’ The g^eral idea is consonant with William 
James’s declaration, that “whilst part of what we perceive comes 
through our senses from the object befom ua, another part (and 
it may be the larger part) always comes out of our heads.” 

While phenomenological psychology lies in the field of field 
psychology and is regarded by some to be a radical branch, this 
book draws less upon field data than I anticipated. It draws 
freely from the data of traditional psychology. Except for some 
of its proposed experimental methodology, there appears to be 
little in it that is incompatible with functionalism or with Wood- 
worth’s general standpoint. Carr’s treatment of perception and 
development of the self seems about as dynamic as that found in 
this book and in many respects ^ quite similar. I think one 
would be hard put to find many examples in Woodworth of the 
neglect of the individual in behavior which is attributed to objec¬ 
tive psychology. However one may view the “new frame of 
reference”—perhaps it will be better received by clinicians than 
by experimentalists—it is a very competent work. It is fresh 
and crisp in style and thought. The educational psychologists 
and, for that matter, classroom teachers should find it particu¬ 
larly valuable. The chapters entitled, “The Goals of Education” 
and “The Task of the Teacher,” are outstanding. Other 
chapters that should make a strong appeal to this same class of 
readers are “The Way Wo See Oursevles,” ^‘The Phenomenal 
Self in Action,” “People Under Threat,” and “Social Structure 
and Action.” 

The main orientation of the book is clinical. A good share of 
its latter portion is devoted to diagnostic and therapeutic pro¬ 
cedures. J. B. Stroxtd 

State University of Iowa 

Jean Paul Sahtbe. The EmoHons. Outline of a. Theory. 

New York: Philosophical Library, 1948, pp. 97. 

In this short volume John Paul Sartre, better known for 
existcntiali.sm tlian psychology, attempts to outline a theory of 
emotions that can be read and understood but not in terms of a 
background of psychology as it is known in the United States 
today. This is instead a phenomenological study. In this little 
volume are considered the contributions and general significance 
of James, Janet and the viewpoints of Kohler, Lewin and Dembo. 
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Dembo is one of tlio heroes of the book, in a sense, since he more 
than James or Janet Tepresents an orientation that Sartre thinks 
he follows. 01 Janet he aays that he was too uncertain, divided 
as ho was between a spontaneous finalism and a fundamental 
mechanism, whereas in Dembo and Lewin he finds the first 
draught for expounding the pure theory of emotion and l)ohavior. 
Sartre himself advises that the pages of the Ixjok should bo 
regarded as an experiment in phenomenological p.sychology. In 
his words he says “we shall try lo place oiirsolvos on grouiuls of 
signification and to treat emotion as a phenomena,” and this 
he does with the framework of concepts and words that will have 
some familiarity to American psychologists, but relatively little 
significance as far as influencing ways of investigation or iiiLorpre- 
tation, Illustrativo of the nature of words and manner in wliicli 
Sartre uses them in the book may be of interest. Some things arc 
expressed in a startling manner as if they were revelations which 
are fairly obvious facts. On the other hand, other ideas arc 
expressed in a flow of words where the meaning gets lost even 
though it is supposed to have significance. 

Psychologists, snya ho, differ in their theories ])Ut agree that 
they should start before anything else with facts. Psychologists 
who might be in agreement about the fact that they hIiouUI not 
accept their own existence in an a priori munuer would bo Hur- 
pi’ised to find tliat they are supposed to discover it in iitiy other 
way but by observing that man is a man bccaii.se ho has the 
characteristics of a man. The general orientation and the H(!{Li’ch 
for the kind of significance that Barlro is known for is iiidi(5at(Ml 
in the last two sentences of the book whicli read as follows: 
“That there are such and such emotions, and only these, mani¬ 
fests without any doubt the factitiousness of human existence. 
It is this factitiousness which makes ncceasary n regular recourse 
to the empirical; it is this ivhieh, in all likelihood, will prevenl. 
psychological regression and phenomenological progrc.ssion from 
ever coming together.” And this is a tragic situation wiiicli f(!W 
psychologists will bewail. Brilliant, some literary p(!ople have 
called tills volume. Interesting rending to some iisychologislH 
this book can be. The curiosity of the reviewer is in what made 
Sartre take time off to write such a book. II. Mi'U/rz,nu 

Psychological Service Center 
St. Louis, Missouri 
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T. W. Richards. Modem CKmcaZ Psychology, New York; 

McGraw-Hill Book Co., 1946, pp. 331. 

The rapidly growing field of clinical psychology can profit from 
a literature which is modernized as well as validated. Large 
scale production and good quality control do not necessarily go 
together in clinical psychology any more than they do in other 
endeavors. In Modern Clinical Psychology Dr. Richards attempts 
to do a very difficult thing; namely, to write a book designed for 
professional students at a level that can be understood by the 
average college junior who has had at least one year of general 
psychology. What he favors is a dynamic approach, and by 
this he means an emphasis on the viewpoints connected with 
such names in the field of personality explorations as Murray, 
Rorschach, Klopfer, Freud and Jung. The clinical psychologist 
as considered in this book is coneei'ned with the behavior of a 
particular individual, with the emphasis on the practical phases 
of behavior; in which respect the clinician resembles the clergy¬ 
man, the personnel manager or the physician more than the 
general psychologist. The ability to understand others is viewed 
by the author as an intuitive gift, and the function of clinical 
psychology is to help improve this gift. 

The heart of the content are seven chapters on appraisal of per¬ 
sonality—two on the appraisal of capacity, two on the appraisal 
of motivation, and three chapters on the appraisal of control. 
These chapters on appraisal are prefaced by four chapters that 
serve as an orientation to the consideration of the problems of 
appraisal. The chapters include consideration of psychology as 
a specialty, methods of psychological appraisal, approach to the 
patient and physical examination. The appraisal chapters are 
followed by two chapters, one on precipitation and disposition, 
and'one on readjustment. The book also includes a fairly 
adequate appendix, bibliography, and a list of visual aids as 
well as an index. 

In one sense the book deserves to be called modern. It is 
dilTerent from previous books; it does pay attention to some of 
the more recent tools for the study of personality that are getting 
a good deal of attention—projective techniques, the Rorschach, 
the T.A.T., and the Minnesota Multiphasic. The author says 
the book attempts to integrate his personal experience in what he 
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conceives to be the specially of clinical psychology. There is 
no denying that this is his purpose. Wiint can be questioned is 
the extent to which pmetiee and literature has registered wltli tljo 
author and practice has been fully understood. In spots it is 
uncritically modern. There ia nothing that 8ay.s that everything 
modern ia necessarily good, and everything that bus a history 
behind it and lias survived is necessarily bad. Comprehensive 
this book ia not. If wisdom from broad living and reading is to 
be expected in a book on clinical psycliology, one will be dis¬ 
appointed here. It does have a good deal of information about 
tools and knowledge, that clinical psychology does at the present 
time applyi which can serve lo inform untrained pooido. The 
Multiphasio ia over-used and uncritically so. Case study 
materials used do not signify the kind of an experienced clinician. 
Instead, they give the impression that it is a man who has 
searched for illustrations, rather than one who has selected them 
from experience. There is only ono reference to Dr. William 
Healy's work, and this is a mention to the Jlcaly Picture Com¬ 
pletion Test, Was Healy not modem cnougii? Tho con¬ 
sideration of introversion-exlrnlcnsion concept is not ovilical. 
Reading disability is practicaHy a neglected pruldom, tliougli 
homosexuality is treated at some length. 

All in all, what can be said of this book is that it can serve as a 
valuable reference book for students of clinical psychology. But 
the author made too many attempts to satisfy too many con¬ 
flicting demands in selection and writing of tlic book. As it is, 
lb is not deep, profound or understanding enough for graduate 
students of clinical psychology on the one hand, and proaupposcs 
much too much content for a person who has had only ono year 
of clinical psychology to be able to make intelligent use of it on 
the other. The book, then, from the point of view of the voviewer, 
definitely does not satisfy the purpose for which it was written, 
but can be used to advantage as a reference worlc. 

II. Mwwkjjji 

Psychological Service Center 

St. Louis, Missouri 
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PHYSICAL MATURING AMONG BOYS 
AS RELATED TO BEHAVIOR 

MABY COVER. JONES and NANCY BAYLEY 
UniverBity of California 

The problems of adjustment which are usually attributed to 
the adolescent period center around the youth's need to develop 
heterosexual interests, to select a vocation, and, in general, to 
acquire the status of adulthood in the eyes of his peer^ and of his 
elders. The impetus for the attainment of independent and 
mature status is undoubtedly related to the adolescent's physical 
changes, but the process of growing up is so complex and so 
interwoven with cultural factors tliab we have not yet been able 
to demonstrate more than a rather general relationship between 
physical and psychological phases of development. 

It is well known that children mature at different rates, and 
reach the period of pubescence at different chronological ages. 
Although the psychological accompaniments of these differences 
in maturing can be examined in terms of mass statistics, this 
approach to the problem is often disappointing because of its 
tendency to obscure the intricacies of the growth pattern and the 
dynamics involved in the process of integration. Case reports of 
individual children have been somewhat more successful in 
their attempts to disclose the processes involved in the attain¬ 
ment of maturity,but the accumulation of individual life 
histories is a slow way in which to arrive at useful generalities. 

The present report deals with two groups of boys who fall at 
opposite ends of a normal sample distributed on the basis of one 
developmental characteristic (skeletal age). In an attempt to 
find differentiating behavior characteristics, statistical compari¬ 
sons of the two groups have been made and illustrative case 
material has been assembled for individuals falling at each 
extreme. The method, while providing no touchstone, does 
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enable us to consider group differences* Avilhout losing sight of 
the individual beliavior patterns of members of the group. 

There are several ways in which childvcn’s physical maturity 
status may bo expressed. One of the moat commonly used for 
girls, is the age of mcnarclie. Aa a possibly comparuhle measure 
for boys, some invesUgatora have uacd Urn ago of appeavar^ce of 
pubic or of axillary hair.” ShuLtlcworth” chisaifind children in 
the Harvard Growth Study according to age ut maximum growth 
in height. Height and Aveight have also been used as an index of 
physical maturity, although maturity differences may he oh.scurod 
by genetic differences in measurements of gross body dimensions. 
This difficulty is avoided by the use of skeletal age norms, from 
x-rays of the long bones of the hand and knee.®‘-“^ Skeletal age 
has the advantage of being a stable and reliably jis.scHSod indica¬ 
tor of physical maturity, closely related to other aspects of 
physical maturing,® and applicable at all ages from birth to 
young adulthood, 

Several studies have dealt Avitli the relationship between 
skeletal maturity and intclUgencc.**”'** CompnvisonH witli 
other psychological factors are relatively scarce. In one of the 
few investigations in this field, Slone and Barker,using the 
ago at menarche aa a criterion, found gvoaf ci’ maturity of inter¬ 
ests among girls who were past the menarche, than among pro- 
menarcheal girls of the same ago. 

1. PHYSICAL CHAnACTBUIBTICS OP THE BAIILY- AND LATJC-MATUU- 

ma GROUPS 

The selection of contrasting extreme groups for the prc.sout 
study Avas on the basis of physical maturity assessments by the 
Todd standards for hand and knee. The group.s included sixteen 
boys who Avere most consistently accelerated and sixteen who 
were most consistently retarded during the four and a half years 
for which Ave had cumulative skeletal x-rays, beginning at iiu 
average age of fourteen years. The total distrihuLion from Avhich 
these extremes were truncated consisted of ninety eases, a normal 
classroom sample of boys in an urban public hcIiooI Hyslem.” 

Figure 1 presenta the comparative maturity asHeHsmenlH of 

* TIxo significance of dlfforonces ia vcporlsd lor a given tige, liriHcU on 
I ratios (Table I); and also for tho sorialim data, boHcd on llio binomial 
test of significance (sections 2 and 6). 
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the two groups at two age levels; each dot or circle indicates 
the skeletal age for an individual case. Some relevant physical 
data are given in Figure 2, which compares the distribution of 
the two groups in height at three age levels, and also with regard 
to adult height as predicted by the Bayley method.®-® The 
age levels used are grade placemente (instead of more restricted 



Fig. 1. Skeletal Maturity Assessments of Early- and Late-maturing Indi¬ 
viduals, at Ages 14 and 17. 

age intervals) to facilitate comparison with the behavioral data 
which are of greater significance when kept in their original 
contexts. 

On the average, the physically accelerated and the physically 
retarded boys are seen to be of the same age, but are separated by 
about two years in skeletal age (the criterion variable). Although 
some overlapping can be noted (Fig. 2) in the height of individual 
children at each age, the means of the groups (indicated by 
arrows) are widely different. Even as early as eleven years 
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(grade H5 and LO) all of the late-maturing are shorter than the 
mean for the early-maturing. At the mean ago of fourteen years 
(grade H8 and L9) the distributions show an extreme separation; 
in the later years of adolescence the dilTerences tend to decrease, 
and the predicted mature heights of the early- and late-maturing 
are very similar. 



Fig. 2, Height Measurements of Early- and Late-maturing Individuals, 

at Four Ages. 

There is also an obvious divorgonce (with no overlap) when the 
two groups are compared in terms of physical maturity ratings. 
This is seen when Greulich’s five-point standards of maturity* 
are applied to photographs taken at fourteen years of ago. Tho 
characteristic rating at this age is 8. Tho mean of sixteen early- 
maturing boys was 4.6 (close to the maximum), with no rating 


* Baaed on latingB of pubic hair and external gonitala.® 
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below 4. The mean of the sixteen late-maturers was 2.0, with 
only two ratings of 3. 

The boys who matured late were relatively very small from 
thirteen to fifteen years. In agreement with Bayley's® study of 
body build in relation to slceletal maturing, they were character¬ 
istically slender built and long legged at all ages. Furthermore, 
their strength tests show them to have been relatively weak at 
the ages when they were lagging in size, and their scores in the 
Espenschade tests of athletic ability® were in most instances 
below average. The early-maturing boys, on the other hand, 
were usually large, broad-built and strong, and tended to show 
good athletic skill throughout the period of our records. Their 
superiority in strength and physical skills was greatest at ages 
thirteen to fifteen, when their early growth spurt accentuated 
their differences in size as compared with the slower-growing 
average and late-maturing boys. This is in agreement with a 
recent report by H. E. Jones, who presents a variety of data for 
groups of boys in the Adolescent Growth Study, considered in 
relation to static dynamometric strength. Strong boys were 
found to be relatively mature in skeletal age, weak boys were 
immature.*® 


2. SOCIA-U BEHAYIOB. IN BOYS’ GROUPS 

The psychological records examined in connection with the 
present study include both observational measures and reputa¬ 
tion scores. We shall present first the ratings made inde¬ 
pendently by three staff members when the boys were in small 
groups (usually six) in a same-sex ‘free play’ situation. These 
will be referred to as ICW (Institute of Child Welfare) ratings.** 
The observations and ratings were concerned, in general, with 
social behavior and personal attributes which are important in 
social relationships. 

The ratings have been converted into standard scores in which 
60 represents the mean of the total group, with an SD of ten 
points. The direction and the degree of a child’s deviation from 
the mean of his group are thus expressed in such a way that com¬ 
parisons can readily be made between accelerated and retarded 
subgroups. 


Reforonoo 14 contains a dosoription of the rating scales and procedure. 
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Figure 3 and Figures 6-7 present cumulalivo standard score 
curves, from ages* twelve to Bcvcntecn, for a Hciin.s of traits 
involving personal appearance, expi-essivoncsH, altuntion-sccking, 
and emotional patterns. jVa shown in Figure 3, the early- 
maturing are consistently rated as superior in physical attractive¬ 
ness, with average scores which reach their liighesl value at 
age fifteen. In general, the group is about one SI) above tho 



Fig. 3. Mean Standard Scorca for Early- and I..atc-maturing gronpa, in 
Phyaical Appcaranco. 

mean total sample of boys. The late-maturing fall aomewliat 
below the group mean, inci'easiDgly so from ago twelve to ago 
fifteen or sixteen. These diffcreuces in altraetivoncss of physiciuc 
are complexly influenced by factors of size and of body Imild. 
Early maturing is not only associated witlx a more raixid growth 
in height, but also with mesomorphy.*® The l)()y.s in lliis group 
tend to be ‘well-built,* muscular, and athletic.f Jly c(jntrasl, 

* The ftverngo ngca arc approximalc, the grou}wi nt en(;)i ago being bnwcJ 
on a grade selocfcioii. 

t By Sheldon’s clasBificalion,** tho average body-build forinuln was 
2.8 - 4.4 - 3,6 for tlie early-maturing; 2.4 - 3.9 - 4.0, for the late-maturing. 
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the more slender, poorly-muscled build of the late-maturers was 
rated as relatively ‘unattractive’ by the adult observers. 

When a comparison is made of the androgynic qualities of the 
builds of these two groups, the early-maturers arc found to be on 
the average more ‘masculine,’ the late-maturers more ‘childish’ 
in their build.* As shown in the lower half of Figure 3, early- 
maturing, as might be expected, is also associated with a some¬ 
what greater attention to the amenities of personal grooming. 
This is expressed in cleanliness, attention to hair and nails, and 
neatness of clothing. 

The difference between the two groups in physical attractive¬ 
ness is most marked at ages fifteen and sixteen. Figure 4 pre- 

APPEARANCE 
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Fig. 4. Comparative IDistributioiiB of Early- and Late-maturing in ‘Appear¬ 
ance' (means indicated by arrows). 

sents compai'ative distributions at age sixteen for a composite 
based on physique, grooming, and attractiveness of facial appear¬ 
ance. Each circle represents an individual case; the means are 
indicated by arrows. So marked is the separation of the early- 
and late-maturing that all but one of the former fall above the 
average of the latter; only two cases among the late-maturing are 
rated above the central tendency of our total group of boys. 

Another group of traits which may have developmental sig¬ 
nificance are those related to expressiveness. Ratings of ‘ani¬ 
mation’ and ‘eagerness’ are presented in Figure 5. In these 
characteristics the earOy-matiiriug aro close to the group average, 
but the late-maturing are consistently above the average. Simi¬ 
lar differences were found for other traits involving expressive- 

* The androgyny rating were made mdopendentfy, for another study."* 
‘Asexual’ ratings (deficiency in masculine development) were much more 
common among the late-maturing, occurring in ten cases of this group as 
compared with only two cases in the early-maturing. Constitvitional, and 
not merely maturational, factors are involved in those androgynic differences. 
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ness; comparisons were mado for behavior denned, at contrasting 
extremes, as talkative-silent; active-stationary; biisy-idlo; 
peppy-indifferent; and laughing-sober. In each of these the 
early-maturing boys were distributed Bimilarly to the total sample 
of boys, the late-maturing were consistently on the 'expressive' 
side of the scale. 

At least two factors are probably involved in determining 
this deviate position of the late-maturing. The first is a per- 
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Kg. 6. Mean Standard Scores for Early- and Lalc-maturiiig groups, in 
Expressive Traits, 


sistencG of a childish activity pattern. A busy scurrying about 
and noisy interchange of shouts and comments is more character¬ 
istic of pre-adolescence than of later years; the adolescent often 
looks down upon such behavior as undignified, and adopts 
instead the r6Ie of a lounger, observing with tolerant supcriorily 
the childish antics of those younger than himaclf. A hcgoiicI 
factor is a reaction formation to inferiority. The ‘active small 
boy* may be expressing through his activity not merely a survival 
of an immature culture pattern, but may also use this, as the 
only technique ho knows, to hold the attention of others and to 
compensate for a physically less favored status. 
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In this eonnectbn, it is instructive to consider the evidence 
concerning attention-seeking behavior, as presented in Figure 6. 
In the upper half of this figure, the late-maturing boys tend to 
vary around the average in the trait *inatter-of-factness.’ Their 
lowest score is at age siTcteen, when they fall on the show-off’ 
side of the scale. In the lower half of the figure, their scores also 
vary around the average on the trait 'unaffectedriess.’ Again, 
they attain a low score at age sixteen; their expressiveness is 



Fig. 0. Mean Standard Scores of Early- and Late-maturing groups, in 
Attention-seeking Behavior. 

judged to have a more affected quality at ages sixteen and seven¬ 
teen than in the years immediately preceding. Although the 
differences are small, this would be consistent with an interpreta¬ 
tion emphasizing a 'natural' or ‘childish’ expressiveness in the 
earlier years of adolescence, and a more compensatory attention- 
seeking expressiveness in the later years. In contrast, the early- 
maturing are at these ages judged to be relatively non-attention- 
seeking: unaffected and matter-of-fact. 

Also pertinent are the ratings for inhibition and relaxation in 
social situations (Figure 7). The late-maturing are relatively 
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uninhibited, but they arc also judged lo he relatively tense. At 
age sixteen, the early-maturing arc on the average approximately 
one SD above the group mean, in the dircelion of ‘relaxation,' 
and the late-maturing are a similar distance below the mean, 
in the direction of 'tenseness.* The carly-inaturing are con¬ 
sistently well-adjusted in this trait, while the lat(5 maturing are 
in most semesters on the less well-adjusted side of the scale. 





40-f—^^^—I—^-1 

12 13 14 15 16 17 
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Fig. 7. Mean Standard Scores of Early- and LntP.-maturing groups, in 
Emotional Fattcrniiig. 

Table I presents the significance of the difforenco.s l)cLwccn the 
early- and late-maturing at age sixteen, based on t ratios. For 
all but two traits on this Hat, differences arc significant at the 
five per cent level or better. In these two traits (animation and 
hminhibitedness') significant dilTcrcnccs are obtained when 
results are considered for all nine semesters in which ratings have 
been recorded, from ages twelve to soventcon, and analyzed in 
terms of the binomial test for consistency.* In attrac.tiveness of 

Based on llio probability that tho differrnon in a werioH of piiinid incns- 
ureswill occur in IhcsamodiTocUonin aHpeoifind proportion of tho iiiMlniuicB.’ 
Since the same subjects arc involved, codhihIciiI difforcnccH iiro hilorprctcd 
as independent of orrors In monauroincnl, but they nro not necessarily 
independent of initial sampling errors. 
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physique, grooming, and relaxation (higher for the late-maturing) 
differences are in the same direction in each of nine semesters, 
with a significance level of .002. Differences of the same con¬ 
sistency were obtained for a numbeT of other traits not included 
in Figures 3-7; these results show that the late-maturing are 
significantly more busy, more active, more ‘peppy/ and more 
tallcative. Differences at the two per cent level (in the same 
direction for eight of the nine semesters) were found for eager¬ 
ness, social initiative, and sociability, in favor of the late-matur¬ 
ing. Differences at the seven per cent level (in the same direction 


Table I.—Mean Standard Scores for Early- and Late- 


maturing 



Early 

Late 

Significance 
of Difference 

Attractiveness of physique 

60.6 

45.0 

.01 

Grooming 

54.6 

49.8 

.05 

Animation 

49.6 

61.2 


Eagerness 

47.9 

59.3 

.06 

Uninhibitedness 

62.5 

60,2 


Matter-of-factness 

60.5 

43,6 

.02 

Unaffectedness 

60.7 

46.2 

.06 

Relaxation 

61.1 

40.6 

.01 


for seven of the nine aemestera) occurred in several additional 
traits, indicating a possibly greater tendency for the early- 
maturing to be good-natured, and for the late-maturing to be 
attention-seeking and to enjoy games. 

It may be noted that the two maturational groups show 
similar rather than different records in a number of traits of 
social importance. Thus, they present no marked nor consistent 
differences in observed popularity,-, leadership, prestige, poise, 
assurance, cheerfulness, or social effect on the group.* 

In view of the relation of maturing to physical abilities, and 
of the high valuation placed upon athletic performance in the 

* As previously noted, tlic measures reported up to this point are based 
on behavior among small groups of boys. Somewhat greater prestige 
differences arc apparent, especially in the later years, ^vllcn measures refer 
to behavior in mixed groups, or to reputation scores based on votes from 
both boys and girls (considered in a later section). 
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adolescent culture,®* it is perhaps surprising that difTorences in 
maturing arc not reflected in such traits as popularity, leadership, 
or prestige. Case reports'*-'® have made it clear that late- 
maturing is sometimes a primary source of social and personal 
maladjustment. On the average, however, the late-maturing 
boy succeeds in maintaining a fairly adociualo status among his 
age-mates; very likely he is helped in this by his activity and 
other compensations, and it is also probable that some of the 
early-maturing are handicapped at times by the fact that they 
have outgrown their age group. 

3. DESCIIIPTIVB DATA 

In Figure 8, which presents unweighted composite values for 
various aspects of expressiveness* at age sixteen, it can bo 
observed that six of the lale-maturing boys fall quite outside the 

EXPftESSIVENEdS 

9** • • Early'I 

> Maluring 

0 0 0 0000 00 . 0 ooccgLolo J 

. - . T_, _ __ 

30 40 60 60 70 80 

Standard Scoree 

Fig. 8, Compamtivo Diatributiona of Early- aiul IJitc-maturing in Expres- 
aivoncaa (means indicated by arrows). 

distribution of the early-maturing. A brief description of each 
of these individuals will provide a more concrete indication of a 
behavior pattern characteristic of nearly half of the physiologi¬ 
cally retarded boys. This pattern of ‘boyishno.s8' is fairly well 
illustrated by the case of Tom'. 

As a junior high school ‘pronclolcsccnt' Tom wob n chubby amnll boy, 
very rosy of check, sparkling-eyed, laughing and dimpled. Ilis gaiety, 
good humor and dynamic activity wore offectivo among Ids own equally 
boyish friends though moat of Ida age-matea conaidcred him to bo qidlo 
immature in behavior. 

Staff mombers mado the following brief rvotnUonB on ibo comment shnola 
recorded during free play aituationa (ngoa indicated in paronthcacs): 

* The component variabicg are talkative—silent; notivo—stationary; 
peppy—indifforont; busy—idle; animated—stolid; cogcr—listless. 
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(13.4) In the nursery school yard: Ho scorned as delighted with the 
children of the nursery school fls though someone had handed him a litter 
of puppies. 

(13.4) At 'free’ play with his own group; Tom played baseball with 
spirit if not with great skill. Hia ootivity was accompanied with continuous 
good-natured comments about the progr^ of the game and the 'boners' of 
his team-mates. 

(13.9) Talking to another classmate: Tom Saylor chattered to Jim Cohn 
about his new job with as much enthusiasm as if ho had found a gold mine. 
He is paid fifty cents a week to pass out handbills for a grocery store; this 
involves getting up at 6:30 every Friday morning. lie was enthusiastic in 
urging Jim to "get in on it.” The latter's indifference seemed to him like 
mild insanity. 

(16.4) In senior high school: Still a small boy in comparison with most 
of his classmates, Tom’s immaturity was obvious in mony ways. His faco 
was still cherubic, his lively and uninhibited activity more typical of younger 
boys, In the tenth grade an observer wrote: "Ho would seem to fit better 
in a junior high than a senior high school setting. Put him in a seventh 
or eighth grade classroom, and his appearance and behavior would be quite 
in keeping with that of the majority of his olaMmates.” 

Tom's clothes were misfits but he was as unconcerned about this as about 
his very dirty hands, although by this time most high school students were 
paying attention to clothes and cleanliness. His voice had not changed, 
as was very evident when he used it orgumcntatively in card games or 
jocularly in good humored razaing. 

On the playground: Tom played pitching pennies with Halph (an early- 
maturing boy) and seemed much more oraotionaiiy involved than the latter. 
He is often a conspicuous figure in chDdiflh souffles; during a friendly tussle 
with several other boys, he was disturbed at finding that he had lost hia 
penny. He was ready to cry and fight about this, the only coin ho had. 

During most of this period (junior and senior high school) Tom seemed 
not to suffer from introspective misgivings about hia adequacy. By some 
magical formula, he apparently had caught and prolonged that legendary 
will-of-the-wisp, ‘happy childhood.’ Tom seemed oblivious to the tide of 
events which swept most of his classmates into an earlier puberty. But 
his euphoric and carefree attitudes ^vere not shown to an equal degree by 
all of the other six late-maturing who were also classified as exceptionally 
'expressive.’ Among these with relatively similar patterns of conspicuous 
and active behavior were several boys who seamed more obviously to bo 
compensating for a sense of physical inadequacy or for loss of a social 
prestige which they had enjo3^ in earlier years; 

Lonnie was a boy previously described by H. E, Jones” as one whose 
physical deficiencies in size and athletic prowess were a persistent source of 
tension and anxiety. His activity pattern was accompanied by excessive 
verbalizations and became more aggrrasive and compulsive as his status 
with the group declined and his homo situation failed to support him during 
this difficult period. 
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Neal, another latc-maturer, poBscsscd ft wclf-knil, athletic build, but waa 
too small to play football or bnBkolbftll on the team, os ho had always been 
too small to compolo with nn older brother, llis notivity was chiofly 
limited to using fithlclic equipment; with other boys in a playground situa¬ 
tion, ho was inclined to be surly and on the doIeiiHivc. 


Bill and Teddy, two good friends from the N«ni« ncighlmrliood, woro active 
as nursery school oliildren are active—they climbed, (ilmsed cacli other, liid 
and ran about. Often they woro the ring lenders in iniBchiovous IndiJig of 
the clothing or books belonging to other boys. 


Milton was described ns agile and quick, “climbcil around like ft monkey,” 

” , . . his energy ouLputseems to be twice Ibttt of an nvcingo licftlthy boy,” 
he 'horsed around’ in mixed group ailuntions. In miich of his group play 
he seemed to invite attack, to enjoy being teased and putnmollcd. At ono 
time, however, he paid a mature classmate ton cents a week to protect him 
from Borne boys ^vho wore pestering him. An undiseiplinctl child of some¬ 
what elderly parents, ho was disorganized, often rebellious, spent his energy 
in omotional outbursts as well as in random activity. 

Tho six moat 'expressive' Inlc-mnliiring bo3*.s were conspieiioua bccauso 
of thoir activity in sltimtions involving small groups of boys. They had 
chosen or woro forced into what appeared, nuporncinlly at least, to bo 
aimilar patterns of behavior. Yet the for.lors whieh determined tho broad 
ospocts of tins behavior pattern were diverso and com])le.v, altering in 
ftBsential ways tUo details of tUo pattern from iudivuUml to in<Uvi<Uval. 

Although expressiveness as excmplincd by tnlknlivcncas, activity, engor- 
nesa and ‘pop’ is a form of behavior which many lale-maUiring boys easily 
assume or toward which they aro predisposed, examples can ho found of a 
quite opposite tendency. Two of tho lato-maluring boys are to bo found 
near the extromo low end of tho scale in oxpressivonc.sa. Tlie.so boys aro 
brothers—Glenn and Charles, They woro cxlrcmoly self-coulainod and 
quiet, finding within thcmHolves and their family saliarnotions in imlinvior 
which did not require nn audience or group participation, 

Both boys were rated as non-attention getting and maltcr-of-fftct; they 
were unsocial, and judged to have litlle cITcct uj)on llicir groiij) of con¬ 
temporaries. When most youngsters were seeking social salisfactiona out¬ 
side the family, Glenn and Charles were still enjoying congoninl rccroatiounl 
interests with their parents. Their summer vncnlion waa n family camping 
trip which involved packing into lonely country where tho fishing and 
hunting was good, Glenn's response to thequcBlion, ‘'Does your mother go 
camping with you?” was, “Yea, sho likes lo get away from p(>()pl(!, Loo.” 

While in some respects Glenn and Charles rnscmblcd tho eiii ly-maluriug 
boys, thoir total complex of traits would never Imvo liul an observer lo 
judge them to bo among tho mote grown-up. Tn addilUm to having tho 
lowest scores among Ifttc-maturers on 'expreasivouesa,' thcao hrotUora also 
had the lowest scores for 'sociftbility,* It is rather to bo cxpoclod that girls 
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would bo outside their world. It was not until after they entered college 
that they began to take any initiative about dating girls. The mother, 
concerned with their 'backwardness’ in this respect, tried to arrange for 
visits from families witli girls of on appropriate age. After one such evening 
she was taken to task by her boys in this fashion: “Don’t ever try that 
again. We didn’t know what to talk about and it was a terrible bore.” 

Glenn and Charles are two boys who were late jn reaching physiological 
and skeletal maturity and similarly slow to take on the social behavior of 
their peers. But in their slowness they remained aloof, bolstered by solid 
but solitary interests rather than by the cncrgotic outgoing patterns of 
activity more common among the late-maturing boys of the study. 


It is obvious that a statistical average which includes the social 
behavior scores of boys as different as Tom and the brothers— 
Glenn and Charles—will provide little understanding of the 
varieties of adjustment patterns adopted by late-maturing boys. 

In analysing the rating scores of the early-maturera, we find 
no clear-out subgroup, such as our half dozen of conspicuously 
active little-boy late-maturers. This may be because the more 
grown-up boys are not required to over-react to an inadequate 
physical status and therefore have not tended to develop any 
one typical pattern in relation to this factor. 

4. CLUBHOUSE REConns 

Ratings and obsei-vations made in mixed group situations 
provide additional material for comparison of these two extreme 
groups of boys. These records were made in a variety of social 
situations, primarily in a clubhouse^® maintained by the Adoles¬ 
cent Study near the school playground. In this situation it was 
possible to observe and rate a youngster’s ‘interest in the opposite 
sex/ based on approved behavior, participation in dancing and 
other mixed social situations, and talking about the other sex. 
As might be expected, marked differences were observed in this 
trait: in each of six series of records, beginning at age 13.5, the 
early-maturing obtained average scores above the group mean, 
and the late-maturing were consistently below the group mean. 
In this as well as in attention-seeking and other expressive 
behavior, a tendency could be noted for the late-maturers to 
show their widest deviation from the early-maturers during the 
period when they were most different in physical respects; in 
senior high school the apparent differences diminished, but as 
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will be seen in the subsequent discu^ion of reputation records, 
the development of a more mature pattern, in the late-maturers, 
does not necessarily imply a prompt change in their status in the 
peer culture. 

The narrative records obtained in the clubhouse situation 
provide evidence of the numerous specific ways in which maturity 
differences are expressed. At a Saturday graduation party 
three of the early-maturers came to the party conspicuously late, 
a mark of sophistication not shown by any of the late-maturers. 
Three others had Saturday jobs, had been working all day and 
were eager to talk to adults about their work. Among the 
observer's comments about the early-maturers were such nota¬ 
tions as ‘he dances well'; ‘seems to think of himself as an adult'; 
^acta a bit condescending'; ^reserved, little energy output'; ‘Ran 
sat in the corner and flirted with Myra’; ‘choek-to-cheek danc¬ 
ing' ; ‘gay and assured, tried to cut in.’ 

In contrast, these phrases described some of the boys who were 
of the same age but were late-maturing: ‘the first time I’ve ever 
seen him with a giiT; ‘he held his head tensely while dancing’; 
‘didn’t dance at all’; ‘acted extremely silly’; ‘Ronnie admitted ho 
had been to only throe dances before'; ‘Claude showed a beaming 
countenance at all times'; ‘began to wiggle and giggle.' 

5. REPUTATION WITH CLASSMATES 

Another source of evidence concerning adolescent behavior and 
Status is from the Reputation Test. For the same age range 
represented in Figures 3-7, data arc available from a series of 
tests in which classmates were asked to wnto down the name of 
anyone in the class conforming to certain descriptions.*® For 
example, “Here is someone who finds it hard to sit still in class,” 
or at the other extreme, ‘‘Here is someone who can work quietly 
without moving around in his sent.” Scores were obtained by 
determining the percentage of times a person was mentioned on 
a given trait description, and these measures were then trans¬ 
formed into standard scores in which 60 represented the ‘indif¬ 
ference point’ (indicating no mentions at either extreme of the 
trait). Reputation scores are less diffei’enliating than ratings; 
they tend to identify outstanding individuals, but may fail to 
distribute the middle range of cases who receive few or no men¬ 
tions from their classmates. As a result differences between 
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early- and late-maturing in aveiuge reputation scores are less 
marked than in average ratings by adults'. However^ a number 
of traits show differences which occur in the same direction on 
six testings, and are significant by the binomial test. 

The late-maturing are consistently more ‘attention-getting/ 
more ^restless/ more 'assured in class/ more 'talkative/ less 
‘grown-up/ and less likely to have older fxiends. On live out of 
six tests they are more ‘bossy/ and less 'good-looking/ 

Less consistency is found for traits which have been established 
as especially important for adolescent prestige. On judgments of 


Table II.—Mean Standard Scores for Refutation Traits 

Early-maturing Late-maturing 


Attention-getting 

48.1 

62.2 

Restlessness 

45.3 

52.9 

Talkativeness 

47.9 

63.0 

Bossiness 

47.1 

62.6 

Assurance in class 

46.6 

60.0 

Popularity 

54.0 

60.7 

Leadership 

51.3 

47.5 

Humor (about self) 

53,6 

48.7 

Having older friends 

56.2 

42.3 

Good appearance 

64.4 

49.3 


‘popular/ ‘leader,' ‘friendly,’ ‘daring/ ‘active in games/ and 
‘humor about self/ the late-maturing stand relatively well until 
the middle period of junior high school, and then tend to drop to 
lower status. 

Table II presents a comparison of average standard scores for 
the two groups in the HIO andL 11 grades. The differences are 
not statistically significant but they present a picture which is in 
general similar to that already found in the observations by 
adults: the late-maturing appear as assertive (in a small-boy 
extroverted way) but at this oge are somewhat lower in prestige 
traits. 

At the earlier ages the more active and energetic of those in 
the late-maturing group were not unsuccessful in winning social 
recognition. But the early-maturing were much more likely 
to get and maintain the kind of prestige accorded to athletes and 
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officeholders. Two of the sixteen early-maturing boys became 
student body presidents, one was president of the boys' club 
(a position next in importance to that of student body president), 
several were elected to committee chairmanships, and four 
attained outstanding reputations as athletes. The sixteen late- 
maturing boys produced only one somewhat 'important' office¬ 
holder (a class vice-president), and one athlete. 

6. CONCLUSIONS 

A general picture emerges from the various ratings and charac¬ 
terizations of these two contrasting groups of boys. Those 
who are physically accelerated are usually accepted and treated 
by adults and other children as more mature. They appear to 
have relatively little need to stiive for status. From their 
ranks come the outstanding student body leaders in senior high 
school. In contrast, the physically retarded boys exhibit many 
forms of relatively immature behavior: this may be in part 
because others tend to treat them as the little boys they appear 
to be. Furthermore, a fair proportion of these boys give evi¬ 
dence of needing to counteract their physical disadvantage in 
some way—usually by greater activity and striving for atten¬ 
tion, although in some cases by withdrawal. 

In interpreting the relationships reported above, it must bo 
borne in mind that we have used somewhat imperfect tools, and. 
that a more complete psychological study of each individual 
could be expected to reveal maturity differences in manifest 
traits and in behavior dynamics which are not clearly shown in 
the comparisons we have been able to make. The question may 
also be raised as to the adequa.cy of our criterion for selecting the 
early- and late-maturing. 

It is doubtful if any single event in the maturing process for 
boys can be compared in psychological importance to the menar- 
che in girls. Skeletal age, as a measure of maturing, is relatively 
satisfactory with regard to reliability and stability. It is 
applicable at all ages from birth to adulthood, and is therefore 
well adapted to longitudinal studies of the same individuals 
throughout their period of growth. But skeletal age is revealed 
only by x-ray. Individual differences in this variable are hidden, 
and hence have received no cultural value-assessments. Feel¬ 
ings of perplexity or inferiority may arise, in relation to early or 
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late skeletal maturing, only in so far as skeletal age is related 
to other physical features (such as size, strength, primary or 
secondary sexual characteristics) or to psychological changes in 
adolescence.* 

It is not surprising that those who are retarded in skeletal 
development should often be directly aware of other aspects of 
physical retardation, and it is not surprising that this should 
lead to anxiety. We have seen, however, that there are many 
complicating factors, which make it difficult to predict the course 
which any individual adjustment will take. Some of our late- 
maturing boys enjoyed a degree of personal security, and status 
in other areas, which helped to balance their temporary physical 
madequacies. A boy like Lonny, whose support at home was 
withdrawn at the same time that his retardation in growth 
became important, bad a more serious problem than Tom, whose 
general security was adequate. Some of the early-maturing 
boys with fine physiques, nevertheless had disturbing accom¬ 
paniments of rapid growth (such as severe acne), which tended to 
offset other advantages. 

Our findings give clear evidence of the effect of physical matur¬ 
ing upon behavior. Perhaps of greater importance, however, is 
the repeated demonstration of the multiplicity of factors, psycho¬ 
logical and cultural as well as physical, which contribute to the 
formation of basic personality patterns. 
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I 

Early in October, 1947, we administered an attitude-interest 
questionnaire to the members of the freshman class of an eastern 
women’s college who had been admitted to the college just three 
weeks before. We will call these our postadmission respondents. 
Subsequently in 1947, and throughout the spring and summer of 
1948, we administered the same questionnaire to applicants 
desiring to enter this college as freshmen in the fall of 1948. 
These girls answered the questionnaire at the same time as they 
were completing their usual application papers. The admissions 
office of the college selected the new fr^hman class from among 
these applicants without recourse to the questionnaire responses. 
After this selection had been made, we segregated the question¬ 
naires of the successful applicants for analysis. We will call 
these our preadmission respondents.* Altogether, there were 
three hundred sixty-two preadmission respondents, and three 
hundred fifty-five post-admission respondents. 

The questionnaire contained one hundred forty-five attitude- 
interest items in the following areas; motivations for going 
to college, study habits and teacher relations, interpersonal 
relations and interests. Answers were given on equal-appearing- 
interval scales of various lengths; twenty-nine items being pro¬ 
vided with four possible responses, ninety items haying five 
possible responses, and the remaining twenty-six items having 
seven possible responses. Examples of items having different 
response scales follow; 


* These data were gathered as part of a larger study of nonintellectual 
factors in collegiate achievement being financed by the College Entrance 
Examination Board. The questionnaire was developed, pretested and 
administered under the general direction of H. S. Conrad. The insights of 
the following research staff members of the Educational Testing Service 
have been particularly helpful in analyses of the completed questionnaires; 
D. G. Schultz, W. B. Schrader, B. F. Green, Jr. 
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Four Response Scale 

Item Example: How appealing would it be to you to join a 
group discussion on strategy for strengthening the United 
Nations? 

Possible Responses: 

1. Not at all interested. 

2. Only slightly intei'ested. 

3. Moderately interested. 

4. Warmly or quite interested. 

First Five Response Scale 

Item Example; Plow important was this reason in causing 
you to apply for admisaon to this college: The atmosphere is 
favorable to serious study? 

Possible Responses: 

1. Does not apply or is of no importance. 

2. Of slight importance. 

3. Of moderate importance. 

4. Of considerable importance. 

6. Of great importance. 

Second Five Response Scale 

Item Example; Do you feel that snoet teachers give you a 
“fair break"? 

Possible ReBponses; 

1. Yes. 

2. Probably yes. 

3. Uncertain. 

4. Probably no. 

6. No. 

Seven Response Scale 

Item Example: Do you feel discouraged after a session of 
studying? 

Possible Responses: . 

1. Never. 

2. Very seldom. 

3. Rather seldom. 

4. Sometimes. 

6. Frequently. 

6. Usually, 

7. Always. 
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II 

When the average r^ponses of the preadmission cases were 
compared item by item with the average responses of the post¬ 
admission cases, we found that they differed significantly (CR of 
2.00 or higher) in ninety, or sixty-two per cent, of the one hundred 
forty-five possible items. Table I shows the critical ratios which 
were found in this comparison. 


Table I.—Critical Ratios op Qubbtionnairb Item Response 
Dipperencbs between 362 Preadmission Respondents and 
355 Postadmission Respondents 


CR 

Questionmdre Items 

Cumulative Total 

Number 

Per Cent 

Number 

Per Cent 

U. 00-16.99 

1 

1 ' 

1 

1 

12.00-13.99 1 

1 

1 

2 

2 

10.00-11.99 ! 

2 

1 

4 

3 

8.00- 9.99 1 

4 

3 

8 

6 

6.00- 7.99 

5 

3 

13 

9 

4.00- 6.99 

28 

19 

41 

28 

2.00-3.99 

49 

34 

90 

' 62 

Below 2.00 

55 

38 

146 ' 

100 


In attempting to explain response differences of this magnitude 
between the Class of 1952 (preadmission respondents) and the 
Class of 1951 (postadmission respondents) one is faced with 
several options: 

I) The differences reflect true attitudinal differences between 
the two groups which might be explained because: 

(A) The groups might have come from different backgrounds 
and therefore were drawn from different populations. 

(B) The preadmission students (Class of 1962) answered the 
questionnaire, on the average, several months after the post 
admission students (Class of 1951). 

(C) At the time the preadmission students answered the 
questionnaire they were, on the average, about six months 
younger than the postadmission students had been. 
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(D) The preadmission students might have based their answers 
upon experience in high school, whereas the postadmission stu¬ 
dents might have based their replies upon experience in college 
(although they had had only throe weeks of such experience nt 
the time they filled in the questionnaire). 

II) The differences do not reflect true altitudinal differences, 
but are simply an artifact which I'csults because: 

(A) The preadmission students answered the questionnaire 
in isolation, while the postadmission students answered in group 
situations. 

(B) The preadmission students were undbr greater pressure 
to rationalize their responses since they had not yet achieved the 
goal of college entrance which they were Booking. 

This list of possible plausible hypotheses illustrates once again 
the well-known difficulty that one can never statistically prove 
anything in social science; the best one can do is to find that the 
possibility of a given hypothesis being true has not been dis- 
proven. From our statistics alone we have certainly not dis- 
proven that any of the listed factors may not be at the root of 
the preadmission-postadmission response differences which wo 
found. Although the magnitvide (rf the differences may not by 
itself be able to resolve this dilemma, we can turn to the content of 
the items and judge which hypothesis seems to make the most 
sense, or be the most plausible, when compared to the quality of 
the differences. 

We have carefully considered all the hypotheses in relation to 
the quality of the differences and have como to the conclusion 
that the hypothesis which seems to make the data as a whole 
hang together is the one which has been listed above as 11(B). 
In another place* the writer has paraphrased Wallin to arrive at 
the general theorem that: **Tbe interposition of a qualifying 
examination for a desired goal will ordinarily shift overtly 
expressed opinions in the direction deemed to be in conformance 
with achievement of the goal, i.e., in the direction of ono’s 
stereotype of the ideal gord achiever." When the pattern of the 
quality of the preadmission-postadmission differences within the 
ninety significant items is closely studied it appears clear that 
the preadmission respondents rationalized their responses in 
accordance with this theorem. 

*R. 0. Myere, “The Academic Ovcrachiover: Storeotypod Aspects," 
Journal of Experimental EduccUiotit March, 1060. 
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We will now set down the qualitative differences found in the 
ninety significant items so that the reader himself may judge to 
what extent the hypothesis of greater preadmission rationaliza¬ 
tion seems to be the most plausible. 

QUALITATIVE DIFFERENCES BETWEEN PREADMISSION AND POST- 
, ADMISSION RESPONSES 

1. Motivations for Going to College 

A) Preadmission respondents gave gi’eater emphasis than post- 
admission. respondents to these reasons: 

Going to college trains one for community leadership, provides 
educational extra-curricular activities, gives training in sociability 
through living in dormitories or sorority houses, provides an 
opportunity of making a great many new friends and these 
friends are valuable help in postgraduation job hunting, gives 
opportunity to learn more about a great many interesting things, 
improves one’s conversational ability. 

Choice of this particular college was made because respondent 
had always planned to go here, the atmosphere is favorable to 
serious study, the college has high intellectual standards and is 
strong in one’s chosen major field of study, one benefits from the 
desirable social background as well aa a good education, many 
girls from the best families go to this kind of college and the type 
of girl one would wish to associate with socially goes here, most 
of one's fi'iends go here, the college is not coeducational and it ia 
known for its attractive girls, it gets one away from home, the 
type of man desired as a husband will prefer a girl who has gone 
here, and future children will be proud that their mother went 
to this college.* 

B) Preadmission respondents gave less emphasis than post¬ 
admission respondents to these reasons: 

College is a good place to meet a desirable husband, there is not 
much to do at home, and expectations of family and friends 
necessitate college attendance. The tuition and other expenses 
at this particular college are comparatively low. 


* It sliould be noted here that although the college is an. eastern liberal 
arts college, it is connected with a state university, draws its students from 
a broad cross-section of high-adiool graduates, and is by no rneans an 
'exclusive eastern girls' school.* 
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2. Teacher Relations and Study Hahita 

A) Preadniissiou respondents presented greater agreement 
than postadmission respondents that they: 

Had had teachers who generally explained things clearly, but 
that when something was not clear they asked the teacher about 
it, had teachers who gave them a “fair break,” who seemed to care 
whether the students learned or not, and who stimiilatod tlie 
students to think about their courses, agreed with their toachors 
on what was considered important in their courses, had teachers 
who paid attention to them aa individuals and who had made 
asaignmeuts clear, and that their teachers have appeared to like 
and enjoy the subjects that they teach. 

Followed a study-plan or study-schedule, estimated jirior to 
study periods about how much they were going to accomplish in 
the time available for each subject, and used odd moments (lilce 
time between classes) to review what they had leai-ned, ^vould bo 
able to maintain an average of five hours per day of study in col¬ 
lege if it were expected of them, believed that most of their school 
work had been rather closely related to their vocational goals, 
thought that examination grades really Bhowed what one knew 
about a subject, believed that school marks or grades wore gen¬ 
erally useful and fair, but had confidence in their ability to pass an 
examination at tlie end of a course Avitliout studying for tlio 
exam, felt that the higher the grades a girl gels in. college fcho more 
she will amount to after college and that grades are one of tho 
most important aspects of school work, believed that the more 
one knows the more money one will eventually have. 

B) Preadmission respondents presented less agreement than 
postadmission respondenfes that they: 

Had found it difficult to underetand what theiv teachers wore 
‘driving at' in class, had teachers who failed to allow enough time 
to get assignments completed, found that thoir teacheis had been 
unfair to them, and felt after an examination ns if they had been 
tricked, accomplished more in courses where the teacher took a 
personal interest in them. 

Lacked confidence in their ability lo do satisfactory academic 
work, felt discouraged after a session of studying, and worried 
about their course work, rend Bloiv.ly, found it difficult to make up 
missed assignments and experiments or to get their daily assign¬ 
ments done on time, felt that much of what they had been learn¬ 
ing in school was wasted effort and tliat many courses offered in 
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college are not useful to a woman, found it was easy for someone 
to persuade them to do something else instead of studying and 
thought that anyone who studies moat of the time is a ‘grind,’ 
were able to study some subjects considerably better than others 
and liked practical subjects better than theoretical subjects, 
found that they spent too much time studying one subject and 
then had to hurry through the others, studied much more effi¬ 
ciently under the pressure of immediate necessity and thought 
that ‘ cramming’ was the best practical way to get good grades on 
a final examination. 

3. Interpersonal Relations and Inierests 

A.) Preadmission respondents rated these attributes of girl 
friends as being more important than the postadmission respond¬ 
ents rated them: 

Mutual curricular and extrarcurriculai* interests, good thinker 
(independent and original), has interesting ideas on current 
affairs and well-cultivated tastes in literature, interested in 
politics, mutual interests in similar business or professional 
career, and keeps appointments on time. 

They also indicated greater interest than the postadmission 
group in these discussion topics: 

Communism in theory and practice, peacetime uses of atomic 
energy in industry, some needed civic improvements, defects of 
the U. S. Bureau of Labor Statistics cost-of-living index, regula¬ 
tion of labor unions by law, current developments in U. S. foreign 
policy, strategy for strengthening the United Nations, the housing 
shortage, rival techniques of color photography in motion pic¬ 
tures, travel by airplane vs. railroad, and a recent popular novel. 

B) Preadmission respondents rated these attributes of girl 
friends as being less important than postadmission respondents 
rated them: 

Interested in dating, gay and car^ree (doesn’t take life too 
seriously), and lacks enthusiasm for the serious ‘career-minded’ 
kind of girl. 

They also indicated less interest than the post admission group 
in these discussion topics; 

How to pick a husband, peculiarities of one’s school teach¬ 
ers, and recent news of happening among one’s friends or 
acquaintances. 

After reviewing the quality of the preadmission-postadmission 
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response differences, we see that the preadmission respondents 
preponderantly represented themselves as being more sober and 
industrious, better adjusted to the requirements of teachers, 
studying and examinations, having sounder motivations for col¬ 
lege and presumably more accoptable reasons for wanting to 
attend this particular college, and more interested in having 
friends and discussions on the serious rather than the carefree 
aide. That this is a result of greater rationalization on the part 
of the preadmission group, rather than representative of ' true ’ 
differences, we have little doubt. * 

III 

Not only did the preadmission respondents give responses 
which they appeared to rationalize as indicating 'bettor' attitudes 
on their part, but they also gave more extreme roaponses than 
did the postadmission group. This situation was anticipated, 
and stems from the hypothesis that overtly expressed opinions 
are apt to bo more extreme when based upon rationalization tlian 
when based upon reality.f The ninety questionnaire items 
which had distinguished between the pieadmission-postadmission 
responses with a CR of 2.00 or higher were, accordingly, tested 
against the following theorem: Considering that every question¬ 
naire item was provided with a response continuum having a 
'pro' terminus and a 'con* terminus, then whichever terminus, 
or pole, the average postadmission response falls nearer, the 
average preadmission response should fall still nearer (i.e., the 

*,Ono isromindod of the earlier report of Simpson that "there is a tendency 
for penitentiary inmates to rate thomselyes higher than college students in 
the possession of generally desirable personality traits,” (R. M. Simpson, 
"Self-rating of Prisoners Compared with that of College Students,” Journal 
of Social P&yckology, 1933, 4, 404-467.) Simpson’s prisoners wanted 'out’; 
our preadmission students wanted 'in.* 

t The conventional interpretation of extremeness of response is that it 
indicates greater intensity of opinion. Among the most recent to present 
this viewpoint is Stouffor who postulates that: "People with the moat 
extreme opinions, pro or eon, also tend to hold these opinions with tlio 
greatest intensity.” (Samuel Stouffor ot al., The American Soldier, Vol. I, 
Adjustment During Army Life, Princeton, N. J.: Princeton Univ. Press, 
1949, p. 43). This viewpoint may bo sound so long as one is referring to 
covertly held opinions only. However, when one is disoUBsing overtly 
expressed opinions, the hypothesis that greater extromoncss of response 
indicates greater rationalization may be equally valid, depending upon the 
social situations under which the responses being coraparod wore obtained. 
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direction of the preadmission response from the postadmission 
response should be further toward the terminus closest to the 
postadmission response). The result of this test showed that the 
conditions of the theorem had been met in the case of sixty-two 
(sixty-nine per cent) of the ninety significant questionnaire items. 
According to the Sign Test advanced by Dixon and Mood* we 
can consider our theorem of exti’emeness of response on the part 
of the preadmission respondents to have been upheld at the one 
per cent level of significance. 

A precise illustration of this situation would have involved 
determining experimentally what Stouffer would call a “region of 
relative indifference” on the continuum for the entire group of 
respondents, and then demonstrating that the responses of pre¬ 
admission students tended to be further removed from this 
region than those of postadmission students. But, lacking this, 
we arbitrarily selected the midpoint of each response continuum 
as most likely being representative of relative indifference. 
Reference may be made to Table II for an illustration of our 
method. Here are presented 16 significant items, from a section 
with a five-place response continuum, in the same sequence as 
they appeared in the questionnaire. Using the mid-point 
answer (“Uncertain”) as a reference point, one notes that in the 
case of 10 of these 15 items the direction and place of the arrow 
shows that the conditions of our theorem of extremeness of 
response on the part of the preadmission group have been met. 
In the case of 5 of these 15 items the conditions have not been 
met. 

IV 

An interesting by-product of this investigation has been the 
provocative finding that the magnitude of the Critical Ratio of 
the difference between the preadmission and postadmission 
responses seems to be directly related to the length of the response 
continuum which was provided for each item. Earlier in this 
paper we mentioned that, of the one hundred forty-five items in 
the questionnaire, twenty-nine had been provided with four 
possible equal-appearing-interval responses, ninety with five 
possible responses, and twenty-six \vith seven possible responses. 
When the data presented in Table I arc broken down by these 

* W. J. Dixon and A, M. Mood, “The Statistical Sign Test," Journal of 
the American Statistical Association, 1946, 41, 657-566. 
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[Mam raaponoo of Postadnisslon atudebto 
InAloatad by Xoag line (|); that of Fre* 
adnlssion otudonts by oboft line (')• 
Arrov Inaicatea dlraoblon Of Alfferenoe.) 


YE8 


HtOBASIrY 

NO 


Do you feal you aoconpHoh 
moro In aoureeo vhere tba 
tdacber takes a pereonol 
Intsraef In you? 3-57 

DO you aike, praotloa^ subjoote 
Doro than theorotlcal eub> 

JegtS? 3i7® 

Ara you abl* to atudy eona 

aubjaotB conaldareibly 

thcui other eUbJaate? 3<39 

Beys your teeohers seemed to 
«Bre vhetber the otudente 
iaanwd or tiot? 4iS0 

po you read alowly! ?i68 

So you thln]< tbot the more 

you Know the more money you 

will eventually have? a.42 

If It were expeetod of your 
would you be able to maintain 
an average of $ houre per doy 
of study In college? 7<9a 

In general^ have your ieooh* 

ere btlnulated the students 

to think about their'ooureos? $•46 

Do you fool that the higher 
the gTsdee a girl gets'In 
college the more ohs will, 
euount to after college? 

Hag moat of your school work 
been rather closely related 
to your vocational goal? 3*l4 

Do you place Inyiortonce on 
tbo idea that your coUego 
career will train you to per- 
tiolpate actively in your 
eosaimnlty? 8.6l 

Do you think that onyone who 
studies most of the time In 

a "arind”? a .63 

Do you feel that most teachers 
give you a "foir break"? 5*7^ 

Do you oonslder grades one of 
the most is^ortaat aspects of 
school work? S .33 

D«, 70 u agree that "oramnlng" 

Is the best praetleal way to 
get good grades on a fln^ 
examination? 3.74 
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Table III.—Critical Ratios of Questionnaire Item Response 
Dipperenges between 362 Preadmission Respondents 
AND 366 Postadmission Respondents, by Length 
OF Response Continuum 


CR 

Length of Continuum 

4 Responses 

5 Responses 

7 Responses 

Number j 
of Items 

Per 

Cent 

Number 
of Items 

Per 

Cent 

Number 
of Items 

Per 

Cent 

14.00-16.99 
12.00-13.99 
10.00-11.99 
8.00- 9,99 
6.00- 7.99 
4.00- 6.99 
2.00- 3.99 
Below 2.00 

Total 

2 

12 

16 

7 

41 

62 

1 

3 

16 

32 

39 

1 

3 

17 

36 

43 

■ 

iim^i 

4 

4 

8 

12 

8 

42 

19 

4 

29 

100 

90 

100 

26 

100 


three different response continua, we find the situation shown 
belo^y in Table III. 

The difference in distribution of CR’s between items having a 
four-response continuum and those having a seven-response con¬ 
tinuum is significant (CR = 4.32); also significant is the differ¬ 
ence between the CR's of the five-response items and the seven- 
response items (CR = 3.55). The difference in distribution of 
CR's between the four-response and the five-response items would 
generally be considered not to be significant (CR = 1.71). 

We realize, of course, that these rather striking differences may 
be a function of differences in item content between the various 
sections of the questionnaire.* However, there was a good deal 
of overlap in content between items having different lengths of 

* This problem will not bo resolved satisfactorily until wo, or some other 
experimenters, have had an opportunity to try out items having different 
lengths of response continua, but exactly the same item content, on matched 
samples of respondents. 
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reaponso oontinua, and w© auapecfc that tho differences are, at 
least to some degree, a function of the length of the response 
continuum. To iia, a reasonable explanation of this phenomenon 
would seem to be that there is a greater reluctance on the part of 
attitude-interest respondents to select n terminal (most extreme) 
response than some other optional response provided on a ques¬ 
tionnaire. In the case of a aeven-rcaponse item, the terminal 
responses can be avoided and still leave live responses from which 
to choose, thus allowing discrimination to that degree. However, 
in the case of a four-response item, if the terminal responses are 
avoided the respondent is left with only two options between 
which to choose, thus allowing but minimal opportunity for 
discrimination. 

Using present Critical Ratio formulas, one might attempt to 
find the optimum length of the response continuum to yield the 
largest possible CR’s for response differences between any two 
differentiated groups. Or, approaching the problem from 
another direction, one might set out to determine how the Critical 
Ratio formulas should be modified so that the CR will be liold 
constant when nothing varies except the length of the response 
continuum. 

BUMUAltY 

An attitude-interest questionnaire was especially designed for 
administration to entering female college freshmen. It hag been 
administered to the members of two successive freshman classes 
at an eastern women’s liberal arts college; in one case shortly 
after the students had been admitted to the college, and in the 
other case when the students were applying for admission. 
Of one hundred forty-five items in tho questionnaire, the answers 
given to ninety were found to diaciiminnte significantly (CR of 
2.00 or higher) between the preadmission and postadmission 
groups. A qualitative analysis of those differencos appeared to 
indicate that tho preadmission respondents were more inclined 
to rationalize their responses than were the postadmission 
respondents. It was also found that the preadmission group 
gave more extreme responses, and this was shown to be significant 
at the one per cent level. From a subsidiary finding the question 
is raised as to whether or not diffei'ences found in magnitude of 
CR’a may be a function of the different lengths of response 
continua provided for different section of items. 



HOSmiTY, COMMJNICATION, 

AND INTEENATIONAD TENSION: 

II. SOCIAL GROUP BACKGROUNDS 

HARRY A, GRACE 
University of Illinois 

A. HYPOTHESES AND INTBODtTCTION 

This study is designed to find what relationships exist among 
expressions of hostility in three kinds of social situations: every¬ 
day, professional (teaching), and international situations. The 
hypotheses are that: (a) different categories of hostile responses 
exist in given social situatioM; (b) measures of hostility among 
the three different kinds of social situations are related; and (c) 
there are differences in social backgrounds between those groups 
scoring at the extremes in types of social situations and categories 
of hostility, The development of the instrument used in this 
study, a discussion of its reliability, and of the results which refer 
to hypotheses (a) and (b) are reported in an earlier paper.® This 
paper is concerned with the results of the comparisons of the social 
backgrounds of subjects scoring at the extremes on this inventory. 

B. METHOD AND PROCEDURE 

The instrument used in this study includes short verbal situa¬ 
tions in three fields* of social behavior: (a) everyday, (b) profes¬ 
sional (teaching), and (c) international. Everyday situations 
include stubbing one’s toe, having a letter returned unmailed, etc. 
Professional situations concern problems of classroom discipline, 
student-teacher relations, etc. International situations center 
about relations between the United States and other countries, 
and include such things as the death of an American in China, 
the British tax on American films, etc. 

After a preliminary test four categoriesf of hostile response 
were formed: autohostile, (expression of hostility against the self 
or the in-group), laisse^faire (allowing the action to continue 
without interference by the subject), verbal-heterohostile, (using 
verbal abuse against a target away from the self or in-group), and 

* Hereafter these areas of sooial beliavior will bo called fields. 

t Hereafter theao reaponeeB will be referred to as categories. 
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direot-hetorohostile (directly attacking a target other than the 
self). 

Thirty situations in each of the throe fields with the four cate¬ 
gories in random order after each situation were given to two 
hundred ton students at Teachers College, Columbia University 
in the spring of 1948. The average age of the group was thirty- 
one. The group was hetorogcncoiiB in background, having come 
from all parts of the country. The following social background 
data were solicited anonymously: sex, age, marital status, 
veteran status, parents’ nation of birth, subiect's nation of birth, 
parents’ annual income,* subject’s annual income,* parents' 
occupation,* subject’s occupation,* and subject’s political and 
religious preferences. (See Table I.) 

C. UEBULTa 

After the item analysis there remained twenty-two situations 
in each field for final scoring, a total of sixty-six situations. The 
reliability, validity, and differences among the various fields, 
categories, and field-categoricst arc discussed in oilier papers.*'® 
Since the relationships between fields and categories are impor¬ 
tant for full understanding of the importance of social group 
backgrounds, the data arc summarized below. 

The three fields wore not found to be significantly different 
from each other. The categories of hostility, however, differ 
very significantly from each other. The subgroup interaction, 
represented by the field-categories, also showed significant 
differences. 

Social backgrounds of the high twenty per cent and the low 
twenty per cent of the subjects scoring in each of the field-cate¬ 
gories were compared. $ A difference of twenty-two percentage 
points is necessary for significance on tlie five per cent level, and 
twenty-eight percentage points' difference is necessary for sig¬ 
nificance on the one per cent level.Eighteen percentage 
points’ difference has been taken as approaching significance on 


* These data could not be included since so many of these questions were 
unanswered by the subjeots, 

t The word field-category refers to the relationship between any field and 
any one of the four categories, o. g., overyday-autohostile, intcrnational- 
verbal-hetorohostile, etc. 

X Full table of these data may be found in 
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Table I.— Summary Table of the Socioeconomic Groups 
Repubsenteu in 'phis Study. Raw Numbers arb 
Given in the First Column. The Percentage 
Falling in Each Classification is Given in 
THE Second Column. Totals Which 
Do Not Equal N or 100 Per Cent 
Are the Result of Ommissions. 

Sex Raw Number Per Cent of Sample 


Female 

125 

60 

Male 

S3 

40 

Marital Status 

Married 

65 

31 

Single 

145 

69 

Veteran Status 

Non-Veteran 

119 

57 

Veteran 

91 

43 

Parents’ Place of Birth 

Outside United States 

71 

34 

Inside United States 

137 

65 

Subject’s Place of Birth 

Outside United States 

14 

07 

Inside United States 

193 

92 

Political Preference 

Republican 

44 

21 

Democrat 

74 

35 

Liberal 

26 

12 

None 

47 

23 

Progressive 

10 

05 

Independent 

09 

04 

Religion 

Roman Catholic 

38 

18 

Protestant 

107 

51 

Jewish 

29 

14 

None 

21 

10 

Agnostic and Atheist 

08 

04 

Occupation* 

Parents’ Income* 

Subject’s Income** 

N = 210 

InBuffioiont rsaponBcs. 
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Table II.— Summary 

OF Social Background Differences 

Discussion is Given in the 

Text* 

A Republicans 

B Democrats 

C Progressives 

E P I 

E 

p r 

E P I 

H a a 

H 


H A 

L “fl 

L 

—a 

L -A 

H 

H V 


H 

L —V 

L 


L — V 

H d 



H 

L -d 



L -d 

D Second 

E Protestants 

F Roman 

Generation 



Catholics 

E P I 

E 

P I 

E P I 

H A A 

H a 

a 

H V 

L -A 

L 

— a 

L 

H 1 1 

H 

-i-i 


L -1 

L 

-L 



H 

V 



L 

-V 



H 

L -D 

+D 


G Non-religious 

H Veterans 

J Afavried 

E P I 

E 

P I 

E P I 

H 

H 

a 

H L 

L D-D 

L —a 

— a 

L -L 

K Females 




E P I 




H h 

L -L 




H D 

L -D 




* Capital letters denote relative relationships between fields, li and t> 
refer to high and low groups. B, V, and I refer to overyday, professional, 

and international fields. 

A, Zr, V, D, both lowor cose and capitals, refer to 

autohostile, laisBez-faire, 

verbal-hfitOTohoatile, and diroot-hoterohostilo 

categories. 
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the five per cent level. In the summary (Table II) only those 
data which approach significance on the five per cent level, or 
which are significant on the five or one per cent levels have been 
included. These data reinforce themselves in various propor¬ 
tions which may be derived from the raw data. 

Republicans tend to be autohostile in everyday and profes¬ 
sional situations, but not in international situations. They are 
not very verbal-heterohostile in international situations, but they 
are more often that way in international situations than in every¬ 
day situations. Republicans are not direct-heterohostile in 
everyday situations, but they are directly heterohostile in the 
international field. (Subtable A.) 

According to the data presented in Subtable B, Democrats 
are verbally heterohostile in everyday situations. They are 
not autohostile in professional situations for the sample tested. 

Progressives tend to be autohostile in international situations, 
but much less autohostile in the everyday field. In the inter¬ 
national field, the Progressives are neither verbally nor directly 
heterohostile. (See Subtable C.) 

Subtable D represents the data regarding the second-genera¬ 
tion Americans. They do not tend to be autohostile in every¬ 
day affairs, but they are autohostile in professional and inter¬ 
national affairs, They are laissez-faire in the everyday and 
professional fields, but not in the intemational field. 

Protestants show autohostility in everyday and professional 
situations, but they are not autohostile in international situa¬ 
tions. They are much more laissez-faire in international situa¬ 
tions than in professional situations. Protestants are more 
verbally heterohostile in the international field than in the pro¬ 
fessional field. They are much more directly heterohostile in 
the international field than in the everyday field. (See Sub¬ 
table E.) 

Roman Catholics tend to be very vorbal-heterohostilo in the 
international field. (See Subiable F.) 

Subtable G shows that the non-religious group is low in direct- 
heterohostility in both the professional and international fields, 
although it is even less directly heterohostile in the international 
field than in the professional field. 

Subtable H concerns the veterans in this sample. They are 
not autohostile in the everyday and professional fields, but more 
autohostile in the international field. The non-veterans are 
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less autohostile in the internationol field than in the everyday 
and professional fields. 

Married people are more taiss^-jaifc in professional than in 
everyday situations. (Subtable J.) 

Women are more laissez-faire in the everyday field than the 
international field. In addition, they are more directly hetcro- 
hostile in professional than everyday situationB, Men react in 
the opposite direction from women in these two dimensions. 
(Subtable K.) 

n, DiscnsaioH 

Reliahilily .—To summarize the discussion on reliability of the 
instrument used in this study, it is suggested that in some fields 
(e. g., everyday and professional) individuals have developed 
generalised responses, whereas in the international field more 
specific responses are forthcoming. 

Laissez-faire behavior seems to be a generalized tendency for 
operations in all of the fields tested. 

Fields and Categories.—The three fields (everyday, professional, 
and international) appear to be subiields of the general area of 
human social behavior. Significant diKercnccs do not appear 
between the fields. The categories (autohostile, laissez-faire, 
verbahheterohoatiie, and direct-heterohtystilo) arc highly signifi¬ 
cantly different from each other. The subgroup interaction 
(field-categories) is statistically significantly different. High 
scorers in a given category in one field tend to be high scorers in 
the same category in the other fields. 3jOw scorers in a given 
category in one field tend to be low scorers in that category in 
other fields. 

Social BaeJeground Data .—^These data come from the high and 
low twenty per cent of the scorers on each field-category. All 
references to groups apply only to those samples which were 
tested in this study. 

Republicans tend to be autohostile in everyday and profes¬ 
sional situations, but contrary to this are direot-heteroliosUlo in 
international situations. They tend to bo more verbally hetero- 
hostile in international than everyday situations. Thus Republi¬ 
cans on this sample tend to direct their hostility toward them¬ 
selves in everyday and professional affairs, and toward others in 
international affairs. 
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Protestants are similar to Republicans in their ways of expres¬ 
sing hostility. They tend to be more laissez-faire in the inter¬ 
national field than in the profesmonal field, as well as being more 
heterohostile in the international field than in the other two. 

The Roman Catholics tested parallel the Republican and 
Protestant groups by their heterohoslility in international 
affairs. This may indicate the similarity among the programs 
of these three groups in the international field today. 

Second-generation Americans tend to be autohostile in inter¬ 
national situations, and not veiy heterohostile at all in that 
field. They are not laissez-faire in the international field, but do 
act this way in the other fields. 

The Progressives approximate the second-generation group, 
and like it are at variance with the Republican-Proiestant- 
Roman Catholic group discu^ed earlier. Progressives tend 
to be very autohostile in international affairs although nob in 
everyday affairs, and show no heterohostility in international 
affairs. 

Veterans are highly autohostile in the international field, but 
not so in the other fields. They are very similar to the second- 
generation Americans and the Progressives. This suggests that 
the war experiences may have had some effect on the veterans, 
perhaps putting them in closer contact with international prob¬ 
lems, making them more critical of our international policies, or 
perhaps motivating them towards the prevention of a future war. 

The non-religious group, which shows low direct-hefcerohostility 
in the international field, lower also than in the professional field, 
seems to support the tendencies of the Progressives, veterans, 
and second-generation Americans. 

The Democrats do not seem to be a homogeneous group in this 
sample. This may be due to the party’s internal political diffi¬ 
culties or to I'egional differences. Democrats are verbal-hetero- 
hostile in everyday affairs, but not vei*y autohostile in profes¬ 
sional situations. Otherwise their data are not significant. 
These data were collected before the 1948 convention, when the 
party’s policies were still in formulation. 

Women seem to be able to express direct-heterohostility more 
in professional situations than are men, but men express this 
hostility more often in everyday situations than do women. 
This may indicate the need for further research regarding our 
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cultural mores as they pertain to the ways and fields in which 
men and women may be expected to express their heterohostility. 
Perhaps male teachers and administrators are expected to net 
differently in frustrating situations than their female counter¬ 
parts. Such data should prove to bo important in the social 
psychological analysis of the school in our society. 

Related Aliiiude Studies—Tho social background data obtained 
on this inventory closely parallel attitude studies designed to 
measure internationalist-nationalist, war-peace, or militarism- 
pacifism attitudes. 

Droba,^ Hayes,*-’ Stagner, ct al,‘* and Stngner^'*-^® reinforce 
the data in this study relative to political differences. 

Eckert and Mills,* Katzoff and Gilliland,® Sappenfield,** 
Stagner ct al,*® and Stump and Lewis'’ are concerned with reli¬ 
gious preferences which are similar to the findings in this study. 
Data on military training seem to differ from the data found in 
this study. Military training seems to be inversely related to 
internationalist attitudes in studies done by Dudychn,® H. W. 
Rogers," Stagner, et al,‘* and Stagner.'* Data in this study 
regarding subjects of foreign-born parents are reinforced by 
Queener’s study,'* although Eckert and Mills* do not find a 
significant difference for second-generation subjects. 

Educational Implications. —Strang'* suggests that aggression 
may be channelled in non-destructive directions by means of a 
careful educative process. She suggests that this training begin 
in the home and carry through the life of the individual. Quecn- 
er’s Btudy'° leads him to conclude that rewards and prestige 
are more frequently given for nationalistic attitudes in our 
culture. 

Strang’s solution requires action on the genetic levels of child 
training, and Queener’s, action directed toward changes in group 
identification. Queener’e argument lends some weight toward 
the concept of building international loyalties through multi- 
or supra-national interests such as workcamps, the arts, the 
sciences, etc. In any ease, we seem to be weakest on action 
steps after we have diagnosed our difficulties. 

A fruitful hypothesis is offered by Newcomb® who suggests 
that hostility of an autistic nature develops when two ov move 
groups are not in communication with one another. With the 
development of this autistic hostility it becomes increasingly 
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difficult to establish communication, and so the cycle proceeds. 
Postwar international relations between the United States and 
the Soviet Union seem to be a case in point. 

The data in this study seem to support Newcomb^s thesis. 
The recent war experiences of the veterans, their travels, their 
contacts with other national citizens, and their reaction to war 
may account for their perception of international problems. 
The recent arrival of the second-generation Americans’ parents 
in this country, their probable contacts with foreign languages, 
foreign newspapers, recent immigrants from their home lands, 
and their vicarious experiences during the past war may be 
offered as an explanation of their perception of international 
affairs. The foreign policy of the Progressive Party, the news¬ 
papers, periodicals, and speeches read and listened to by Pro¬ 
gressives may offer some clues as to the forces which form their 
frame of reference. We might expect some of the persons who 
claim no religion on this sample to be humanistic in their world 
outlook, and, in so doing, to avoid heterohostile reactions which 
might lead to war. In contrast the foreign policy of the Republi¬ 
can Party, the editorial policy of newspapers which Republicans 
might be expected to read, the traditions of individualism and 
isolation (physical and psychological), and the probability of less 
contacts between Republicans and persons of foreign birth, 
might account for the Republicans’ frame of reference. Prot¬ 
estants might be expected to be similar to the Republicans in 
these respects. The Roman Catholic group on this sample is 
probably influenced greatly by the diplomatic policies of the 
Vatican, and so information received from that source might be 
expected to build their particular world outlook. 

In summary, it is suggested that for this sample, the differences 
among expressions of hostility in the international field may be 
accounted for by differences in the kind and degree of verbal and 
physical contact (communication) with international affairs. 
It is further suggested that controlled changes in communica¬ 
tion may be expected to affect the types of hostile responses of 
the groups studied. This is a suggestion for future research and 
has not been fully covered in this study. 

If the process of education for better international under¬ 
standing be seen as a re-educative or therapeutic one, Newcomb’s 
hypothesis seems to be most fruitful for fvirther action-research, 
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The problem becomes one of bringing the groups into better com¬ 
munication with the international field. The differencea may 
then be considered to be essentially dynamic ratlier than genetic 
in character. The genetic approach to this problem is too often 
fraught with hypothetical causal relationahipa which operation¬ 
ally are meaningless questions. Studies in methods for the 
improvement of communication between groups liecomo of 
greatest importance. 

The problem of what type of education is needed to develop 
adults who express hostility in ways which are non-pathological 
to themselves and to society is one which deserves deepest con¬ 
sideration. Since individuals tend to exhibit consistent patterns 
of hostility, it may be important to discover the rclationsliips 
between these patterns and other personality clraractcristics. 
Perhaps of greatest interest to the educator arc the data demon¬ 
strating the consistency of th^e patterns of hostility for the 
individuals on this sample, This suggests that the cliniigo of an 
individual’s expression of hostility in one field will affect a similar 
change of that expression in another field. Should this be 
demonstrated (research is underway), we would bo al)lo to edu¬ 
cate less directly but more generally and effectively for healthy 
international relations involving fewer tensions. 

To attempt any large scale educational program before com¬ 
pleting further research to more conclusively determine the most 
effective techniques, would be presumptuous. However, tlic 
data do offer a field for hypotheses, some of whicli have already 
been raised in the discussion, and some of which appear below. 

SUaGESTIONB TOR FURTHER RESEARCH 

1) A study of hostility patterns might be done with subjects 
who are at various stages of teacher-training or post-graduate 
teacher-training. Such data might yield information helpful 
in the selection of teacher candidates. Social studies teachers 
might constitute a special group for study since they will be 
faced with the interpretation of international problems through¬ 
out their professional work. 

2) The original study reported hero might profitably be 
altered for standardization with other minonty gz'oups. 

3) Subjects might be sorted into groups on the basis of their 
scores on this inventory, and studies made of their overt hostile 
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behavior in a group setting. Their reactions to the group process 
in education- may be closely identihed with their hostility pat¬ 
terns. Such data should prove valuable for educators using 
group dynamics methods. 

E. CONCLUSIONS 

1) Republicans, Protestants, and Roman Catholics on this 
sample tend to express more heterohostility in the international 
field than they do in the everyday and professional fields. In 
the everyday and professional fields the Republicans and Prot¬ 
estants on this sample tend to be autohostile, 

2) Progressives, second-generation Americans, and veterans 
on this sample tend to express autolwatiUty in the international 
field. Progressives and second-generation Americans tend to be 
much less autohostile in the everyday field. Progressives tend 
to be less autohostile in the professional field, loo. Ron-religioua 
persons do not tend to be direct-heterohostile in the professional 
field, and are even less dhectly heterohostile in the international 
field. 

3) With regard to the third hypothesis of this study, it has 
been shown for the two hundred and ten subjects tested that 
certain significant differences exist between extreme scorers in 
field-categories with reference to their social group backgrounds. 
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INTRODUCTION 

There has always been conti’oversy over the relative merits of 
personal opinions and objective mej^urements as selectors of 
personnel. In a simple situation, the grade-school teacher insists 
that his evaluation of a pupil has as much weight on a report 
card as examination scores. In a more complicated situation, 
the psychiatrist maintains that his concept of the etiology of a 
patient’s disorder is more accurate than the composite results of 
a battery of psychological and psychiatric tests. Intuitionists 
and non-scientifically trained persons are often guilty of over¬ 
emphasising the importance of personal opinions. Psycho- 
metricians and zealous immature scientists are often guilty of 
over-emphasizing the importance of measurements. 

Few honest attempts have been made to assess the relative 
merits of these antipodes. Yet, it is worth while to do so. For 
instance, in a large scale selection program, as in the selection of 
young men for flying training in wai'time, decisions have to be 
made in regard to the type of selectors used. On the one hand, 
impressions from interviews have the advantages of flexibility 
and of the weighted summarization of information due to the 
Gestalt-like features of the mind. On the other hand, objective 
test batteries have the advantages of convenient administration 
to large groups of subjects and statistically definable selection 
power. Efficient administration of such a selection program 
requires a knowledge of the order of magnitude of these advan¬ 
tages. Furthermore, it is of scientific interest to compare the 
statistical activities of the human brain to the techniques of 
psychometrics. 

The work of this paper was undertaken to estimate the efficacy 
of clinical impressions as selectors in a particular selection pro¬ 
gram, and to study the nature of clinical impressions as products 
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of the brain as a statistical machine. The particular program 
was the selection of candidates for flying training in World War 
II. Thus the data of this study are fixed historically, and there¬ 
fore it is recognized that tho results may not have as broad an 
application as one might hope for. Tho rcsulis hore aro pre¬ 
sented as evidence for the conclusions; not as proof. 


methods and nESUDTS 

To a group of three hundred eighty-nine physically-fit 
young men inducted into the armed services in 1943, especially 
thorough psychiatric interviews were given by flight surgeons. 
The subjects were a more or less random sample of applicants for 
training. The interviewers were graduates of a course in aviation 
medicine in which the psychiatry of flying por-sonncl was taught.* 
The psychiatric examination was called the ARMA, tho Adap¬ 
tability Rating for Military Aeronautics. This group of appli¬ 
cants was allowed to go through flying training regardless of the 
opinion of the psychiatrists. Hci»cc, tho actual failures in 
training can be compared with the predicted failures. 

At each interview tho psychiatrist completed a check-list of 
thirty-one psycho-social items and then wrote down his prediction 
for success in flying training (item 32) and for success in combat 
(item 33). An abbreviated list of these items is shown in Tabic I. 
Detailed description, of tho items is given clsowhcro.^ Tlio 
actual outcome of elementary flying training is also given, in 
Table I as item 34, ‘Criterion.' Thus, the matrix of Table I 
yields the interassociations, in adjusted contingency coenicientfl,t 
for all pairs of items of the interview, and for each item with tho 
criterion. Clusters of related items aro evident at first glance. 
Valid items, those which were able to predict failures, arc easily 
picked out in the last row or the lost column where tho coeflicient 


* A complete description of the subjeota and tho inlorviewers is given in 
Deemer and Kafferty.* 

t Adjusted contingency coolBciont is designated by C, 


C 



X* Vhk 
^ +x* Vhk^ 


1 


where: x* - Chi-squaro computed on by it contingonoy table H = 389 
In Table I, Cis written as 100(7 to eliminate decimal points. The atatistical 
significance of C is that of the x* on whioh C is computed. 
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is pre6xed by a, the five per cent significance level value of 
the coefficient (chosen arbitrarily as statistically significant 
association between items.) The valid items are ^Nationality/ 
'Achievement/ ‘Prediction for success in flying training/ and 
'Prediction for success in combat.' 

Clusters of items are of particular interest, since few psycho¬ 
social items per se wore good selectors but the clinical impressions 
based on these items were relatively good selectors.* One would 
like to know how these various items are related so as to supple¬ 
ment one another in the considered opinion of the psychiatrists. 
First, a coefficient by coefficient subjective analysis was made of 



>0 m4 9S ir» Ohr*4 rra)^'i uti 


l^ll 

«i riuUMiui iM** 

• I iBferlMl UA »( 


statistically significant associations in regard to the type of 
relationship between items. In Table I judgment of the type of 
relationship is signified by prefixing the coefficient with either a, 
for natural relationship, b, for systematic relationship, or c for 
semantic relationship. Furthermore, an examination of the 
cases of statistically insignificant association in relation to what 
the interviewers thought, as reflected in interassociations with 
the clinical impression items (nos. 31 and 32), led to the judgment 
of important lack of association, signified by the prefix —. 


* Tho adjusted contingency cooffleient, C, for the clinical improagiona 
Was about .40, which is comparable to tho correlation coefficient of .55 for 
tho psychological teat battery given to these same subjects.* 
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Second, a multiple factor analysis was performed on the matrix 
of interassociations of Table I. The centroid method of factor¬ 
ing of Thurston©’- was employed, ^Factoring was terminated 
when the distribution of residual contingency coofTicients, after 
the removal of components due to the factors already found, 
was approximately normal with a mean of zero, and a standard 
deviation of nearly (389)“^, the theoretical values for random 
fluctuations of correlation cocfficicnta based on three hundred 


Figure I. DIsUibuHon o( residuals In Ihe loclor onolysis of ARMA Items, ofter th« 
extraction ot four factors. 
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eighty-nine individuals. This distribution is shown in cumula¬ 
tive form in Figure 1. 

Four factors, A, B, C, and D, were sorted out as accounting for 
the common variance of the thirfcy-four items. Tlio factor load¬ 
ings and the communalitira are listed in Table 11, after one rota¬ 
tion. Other rotations, including oblique ones, were attompLod 
with little or no improvement in the pattern, from either a 
practical interpretation point-of-view or a 'simple structure’ 
point-of-view. This first rotation of 46° in AB and AC leaves 
the factors orthogonal, and therefore statistically independent. 
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Table II.—Factor Loamnos of ARMA Items after One 
Rotation. The Faittors Ari] Orthogonal 


Item 

Factors 

Common 

Variance 

No. 

Name 

A 

B 

G 

D 

1 

Age 


.247 


.669 

.8705 

2 

Nationality 

.616 

.148 


.240 

.5137 

3 

No. Brothers 

.368 

.198 

.311 

.163 

.2970 

4 

No. Sisters 

.424 

.141 


.177 

.2886 

6 

Parental Status 

.516 

mm 


.141 

.2866 

6 

Upbringing 

.462 


- .014 

.092 

.2137 

7 

Income 

.266 

.158 

.108 

.163 

.1272 

8 

Habitus 

.099 

.339 


.332 

.3190 

9 

Reactions 

.205 


.198 

.106 

.1849 

10 

Tension 

.092 

.643 

.198 

.673 

.7894 

11 

Tremor 

.021 

.629 


.636 

.8008 

12 

V.M.I. 

.071 

.637 

.014 

.660 

.6140 

13 

Achievement 

.283 

.390 


.389 

.6618 

14 

Blood Sports 

.283 

.184 


.269 

.2626 

16 

Artistic 

.219 

.177 

.247 

.276 

.2166 

16 

Habits 

.134 

.191 

,184 

.134 

.1062 

17 

Alcohol 

.382 

.113 


.269 

.2731 

18 

Tobacco 

.262 

.134 

.141 

.071 

.1116 

19 

Gambling 

.325 



.127 

.1320 

20 

Religion 

.462 


.339 

.177 

.3638 

21 

Religiousness 

.304 


,113 

.127 

.1479 

22 

Marital 

.673 


.488 

.622 

.9638 

23 

Children 

.474 


.474 

.666 

.7721 

24 

Sex Drive 

.339 

.184 

.431 

.410 

.5026 

26 

Attitude 

.177 

.516 

.269 

.438 

.6618 

26 

Aggression 

.191 

.445 

.184 

.283 

.3486 

27 

Personality 

.064 


.134 

.255 

.2495 

28 

Personal Qual. 

.233 

.587 


.283 

.7380 

29 

Family Attitude 

.304 

.163 

.184 

.198 

.1920 

30 

Interest in Flying 

.297 

.354 


.346 

.6100 

31 

Passenger Time 

.326 


.318 

.198 

.2749 

32 

Pred. Training 

.078 



.120 

.9136 

33 

Prcd. Combat 

.092 

.714 


.099 

.9237 

34 

Criterion 

.226 

.354 

.452 

.141 

.4006 


Sum 

9.538 

9.481 

9.486 

9.646 
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INTERPRETATION OP THE RESULTS 

Some of the objectives of this study aro not easily readied, 
regardless of the availability of all existing relevant data. To 
examine the operations of the human brain as those of a statistical 
machine, for instance, is not a modest endeavor. Therefore, this 
study is offered as a limited contribution to our knowledge of the 
structure and components of psychiatric impressions during inter¬ 
views. Moreover, certain of the factual results are applicable 
in the particular setting of these data, viz., the selection of young 
men for flying training in the Air Force by psychiatric interview. 

These factual results are more eaeily interpreted, so they will be 
discussed first. It has already been sliown* that particular 
psycho-social itecM are of little value in selecting good flying 
studente, with the possible exception of ‘Achievement.’* Experi¬ 
ences of other investigators* with similar types of items but in 
quite different operational settings arc in agreement with our 
findings. Generally speaking, one can reasonably assert that 
what a person has done is a fair mcastiro of what ho can do. A 
person’s age (within physical fitness limits), religion, morality, 
smoking habits, number of siblings, love of parents, etc. aro such 
weak elements in new achievements that they are easily over¬ 
whelmed by elements of motivation and specific abilities. 

It is shown in Table I, however, that a psychiatrist can ovoiu- 
ate these various biographical and psycho-social data during an 
interview and arrive at a relatively high prediction coefficient. 
On the basis of experience and education, the interviewer sub¬ 
consciously weights data and summarizes them in his impression, 
much the same thing that is done in the classical statistical tech¬ 
nique of multiple regression. One might well ask how many 
basic factors are common to the items and the impressions. And 
further, one might also ask whether those basic factors account 
for the whole clinical impression. In conversational language, 
one wants to know whether “the whole is greater than its parts ” 
(i.e., those parts listed). The evidence duo to the piecemeal 

* ‘Nationality’ in Table I has as high a validity cooflioinnt as 'Aohiovo- 
mont.' Yet the former is not stressed in tlw toict as important bcoaviso wo 
believe that this finding ia peculiar to our samplo. All tlio contribution to 
X* was due to men of Slavic origin. Moreover, the x* for ‘Aohiovoment’ is 
signifioant at the one per cunt level, whereas Iho x* for ‘Nationality’ Is at 
the four per cent level, just over the arbitrary boundary. 



Factor Analysis of Psychiatric Impressions 


179 


examination of the types of correlational relationships among 
items and that due to multiple factor analysis will be discussed 
next. 

The psycho-social and biographical inventory represented by 
the first thirty-one items of Table I is quite thorough. In 
attaining such thoroughness one cannot help choosing items 
which overlap in one way or another. Some items are correlated 
in the physical world, although one do^ not know the degree of 
correlation ahead of time. Such statistically significant associa-- 
tions between items have been termed ‘natural relationships 
between items/ and have been designated by a in Table I. The 
relationship between ‘ 24. Sex Drive’ and ' 1. Age' is an example. 
Some pairs of items are correlated because the variation in one 
item necessarily (or at least very probably) accompanies variation 
in the other item. In Table I such cases of statistically signifi¬ 
cant association have been tcimed ‘systematic relationship 
between items/ and have been designated by h. The relation¬ 
ship between ' 22. Marital Status’and‘23. Number of Children’ 
is an example. Yet other pairs of items are correlated because 
the meaning of one item implies part of the meaning of the other 
item. Again in Table I such cases have been termed ‘semantic 
relationship between items/ and have been labelled c. The rela¬ 
tionship between ‘10. Tension’ and ‘12. Vaao-Motor Insta¬ 
bility’ is an example. 

finally, in the case of certain item paiin which lack statistically 
significant association, the opinion is made that this lack of 
relationship is interesting. Such cosra in Table I are termed 
‘important lack of o^ociation/ and are labelled —. For 
instance, ‘2. Nationality' and ‘32. Prediction for Training' are 
not correlated, indicating that the psychiatrists did not consider 
nationality per se a determiner of flying ability, whereas the item 
‘2. Nationality’ in this sample of fl^ng candidates showed sig¬ 
nificant association with the criterion; namely, pass-fail in flying 
training. As pointed out above, if one oxaminoa tho complete 
contingency table for ‘2. Nationality’ vs. ‘34. Criterion,’ one 
finds that only men of Slavic origin made significant contribu¬ 
tions to Tracing the matter furtlier through complete con¬ 
tingency tables, it is found that tho psychiatrists discounted 
nationality per se, but counted tho emotional stability of the 
subject, i.e., ‘10. Tension/ ‘11. Tremor/ and ‘12. Vaso-Mofcor 
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Instability'; and that men of Slavic origin in this sample (no 
generality implied!) of candidates for flying training showed 
deviations toward emotional instability os shown in their con> 
tributions to x* in items 10 and 13. 

Admittedly^ the judgment of the typo of relationship in tho 
case of each item-pair is personal and somewhat arbitrary. How- 
ever, this reduction of the number of different matters to compre¬ 
hend in the perusal of Table I is helpful in arriving at simple but 
useful speciho and general conclusions. One such specific con¬ 
clusion is exhibited in the above paragraph. Other specific 
conclusions can be gleaned from tho individual contingency 
tables. Reproduction of the five hundred sixty-one contingency 
tables here is prohibitive, althouglia psychiatrist interested in the 
factual elements of this study would find the scrutiny of these 
contingency tables worth while. Without the evidence of these 
tables, then, a few more specific conclusions will be given. 

Within the age limits of Air Corps volunteers among inductees, 
age was not a factor in flying ability insofar as ‘1. Ago’ was not 
associated with ‘34. Criterion.! Moreover, the flight surgeons 
did not believe that age per so was aftwjtor. Age is systematically 
associated with achievement (it tak(» time to achieve something), 
marital status, sexual drive, and passenger time. Yet, some of 
these items are valid. Apparently, interviewers isolated ago as 
an unimportant factor in these items. 

Even brief examination of Table I reveals a complex of items 
associated with the clinical predictions; viz., ‘8. Habitus,’ ‘9, 
Reactions,’ ‘10. Tension,' '11. Tremor,’ *12. Vaso-Motor Insta¬ 
bility,’ *2B. Attitude,’ ‘26. Aggression,’ *27. Personality,’ and 
‘28. Personal Qualities.’ None of these items alone was strong 
enough to reach statistical significance. Yet, this complex 
allowed interviewers to extract the relevance of many items, 
otherwise irrelevant. 

Painstaking coefficient by coefficient subjective analysis hoe 
provided some insight into the nature of psychiatric impressions 
in this type of setting. By educational training and by intuition 
(percentage admixture unknown) tho iniorviowor seems to 
extract certain elementary relevancies or basic factors from the 
multifarious continuous and discrete sensory data offered him 
during the interview. He is seldom conscious (how fortunate!) 
of this faotoriaation; his decision flows from some general impres- 
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sion of certainty in hia choice among alternatives. It is not even 
known whether factorization occurs at some other level of the 
nervous system. 3?aotorization may be a schematic fiction, 
poorly suited as a model for Gestalt intellectual processes. Per¬ 
haps continuous recognition in time-space-sensory data 'space' 
is more germane. 

Assuming for the rest of tlris discussion that factorization is an 
appropriate symbolic model, one can compare brain factorization 
with statistical factorization. Any of a variety of systems of 
factor analysis can be chosen for this purpose. Here, the tech¬ 
nique of multiple factor analysis of Thuretone* was applied to 
find the factors common to the thirty-four items. Four inde¬ 
pendent factors, A, B, C and D, were found to account for all 
the common variance ('communality') of the thirty-four items. 
The factor loadings in Table II indicate how much of each factor 
is in each item. In the absence of an estimate of the sampling 
error of factor loadings, we arbitrarily chose .30 or above as a 
signifioaut loading. 

Table II seen with this point-of-view suggests names of A, B, 
C and D. Factor A is the ‘Age coefficient’-—the element in 
those items which takes time to develop, as marital status and 
passenger time in commercial aircraft. Factor B is ‘Poise at 
interview’—the aggregate of those things which convey a 'good 
impression' during the interview, posture and body build, reac¬ 
tion time, emotional stability, attitude, and others. Factor C is 
‘ Achievement ’—^how the person has been, able to get along in the 
world, as scholarship, successful married life, social acceptance, 
sexual adjustment. Factor D is an 'Artifact’—an apparently 
nonsense conglomeration, perhaps a result of sampling errors in 
factor loadings in this not-lavge sample (N = 389). 

Factors A, B, and C correspond quite well to the factors of age, 
tension-tremor-aggression-complex, and acluevement, uncovered 
in the coefficient by coefficient analysis of previous paragraphs 
which, in a way, was a crude factor analysis. Factor loadings in 
Table II show that A, 'Ago coefficient,' contributed a fair share 
to items in general (Sum 9.538), but little to the psychiatric 
impressions (No. 32 .078; No. 33 .092) and little to the ability 
of learning to fly (No. 34 .226). Factor B, 'Poise at interview,’ 
contributed a similar amount to all items taken together (Sum 
9.481), and was important as a factor in flying training both in 
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tlie opinion of interviewers (No. 32,686; and No. 33 .714) and in 
actuality (No. 34 .364). I>’actor 'Achievement,' likewise 
contributed broadly to the variegated items (Sum 9.486), and 
likewise was important in opinion (No. 32 ,650; No. 33 .029) and 
in fact (No. 34 .462). 

Other interesting inferences can be drawn from the multiple 
factor analysis. For instance, the four isolated factors common 
to all items account for most of the variance in the cl inical impres¬ 
sion (No. 32 .9136; No. 33 .9237). This communnliLy ja of the 
same order of magnitude as the reliability of these clinical impres¬ 
sions, based on data from repeated interviews by the same and 
alternate interviewers on the same subjects. Thus, one could 
infer that in this case the clinical impression is 'a whole equal to 
the sum of its parts’ (i.e. those listed). Moreover, no factor 
emerged which was common only to the clinical impression and 
the criterion. Such a doublet might have arisen had the inter¬ 
viewer had some sort of super-sensory insight into the factors 
important in flying not otherwise sampled by the existing items, 
Suppose one must know the command ‘Open Sesame’ in ordor to 
make an airplane fly, but one is nob taught this command in 
flying training. The interviewer who determines the knowledge 
of this command in the subject has such insight ns to produce a 
factor doublet in the item list under discussion. Finally, the 
small coramunality of the criterion (No. 34 .4006) implies the 
existence of further factors in the ability to learn to fly which arc 
not present in all the other items nor in the clinical impressions. 

SUMMARY 

A multiple factor analysis was performed on the intorassocia- 
tion matrix of thirty-one biographical-psycho-social items, psy¬ 
chiatric impressions, and a pass-fail criterion in a sample of 
three hundred eighty-nine flying cadete. Four orthogonal fac¬ 
tors emerged: A ‘Age coefficient,' B 'Poise at interview,’ C 
‘Achievement,’ D ‘Artifact.' Only Factors B and C were 
important in the psychiatric impressions and in the criterion, and 
accounted for almost all of the common variance between these 
two variables. All reliable variance of the psychiatric impres¬ 
sions was attributable to these isolated factors, indicating (not 
proving) that in this case the clinical impressions were ‘wholes 
equal to the sum of their parts.' 
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PREDICTING SUCCESS OE ENGINEERING 
STUDENTS 
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Of all students graduating from high school, roughly one-fifth 
ere seriously considering entering occupations involving scientific 
and technical training. Many of these students are trying to 
decide whether or not they should attempt to become engineers. 
Of a random sample consisting of five hundred men who came to 
the Student Counseling Bureau of the University of Minnesota 
for counseling, one hundred sixteen or twenty-three per cent 
were contemplating engineering as a career, and eighty-nine of 
these already were matriculated in the Institute of Technology. 

In order to provide students with relevant information about 
their chances for success or failure in engineering training, high- 
school and college counselors, administrators, and teachers must 
have available predictive indices of known accuracy and of 
contemporary value. 

The purpose of the study here reported was to evaluate a bat¬ 
tery of tests assembled to assist in the prediction of academic 
success for students considering engineering training as one of 
their educational alternatives. 

Several previous prediction studies for engineering Btudcnls 
have been reported.These studies have been of value in 
the counseling of students, but in light of the increasing and 
perhaps changing enrollment in technical schools and with con¬ 
current curricular and professional developments, a re-appraisal 
of the predictive techniques should be conducted. 

METHOD 

In the fall quarter of 1947, a total of 1,019 freshmen wore 
enrolled in the Institute of Technology of tlio University of 
Minnesota. During the first week of the fall quarter, all first- 
quarter freshmen were supposed to take a battery of tests ^vhicli 
included; 


184 



Predicting Siiccess of Engineering Students 186 

Cooperative General A.cMevement Test, Part III, A Survey 
Test in Mathematics, Form P 

Cooperative Chemistry Tost, Form Q 

USAFI Tests of General Educational Development, College 
Level, Test III, Interpretation of Reading Materials in the 
Natural Sciences, Form B 

Revised Minnesota Paper Form Board, Series M.A. 

Scores on the American. Counwl on Education Psychological 
Examination, College Form, 1937 edition, and on the Cooperative 
English Test, Form OM, were also available for most of these 
students, as was the student’s percentile rank in his high-school 
graduating class. College grades for the first quarter and for 
the first year were available and honoi^point ratios were based 
on these grades. 

From the five hundred twenty-four first-quarter freshmen 
who were tested, complete data at the end of the first quarter 
were avaliable for three hundred one students. The remain¬ 
ing two hundred twenty-three students were excluded because 
they had left college before the end of the quarter, they 
had not completed their tests, their records showed transfer 
credits from other colleges, or after the first week of the quarter, 
they had decided not to choose a major in the Institute of 
Technology. 

Students in the Institute of Technology select their major 
from curricula which provide sixteen major sequences. The 
number of freshmen in these major groups varies. The courses 
these students take during tlieir freshman year, however, are 
the same with one exception. Chemistry majors and chemical 
engineering majors take inorganic chemistry 9-10-12. All other 
freshmen, if they have had chemistry in high school, take inor¬ 
ganic chemistry 4-6-11, and if they have not had chemistry in 
high school, take inorganic chemistry 1-2-11. 

Before students in the different major groups could be com¬ 
bined, the means and variances for each of the groups were 
compared on the basis of high-school percentile rank, American 
Council Examination score, and first-quarter lionor-point ratio. 
On the basis of the consistency of the observed differences, for 
further analysis the group of three hundred one was divided into: 

Group I—majors in chemistry and chemical engineering, all 
of whom had chemistry in high school. N = 65. 
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Group II—all other majors who had chemistry in high 
school. N = 189. 

Group III—all other majors who did not have chemistry in 
high school. N — 47. 

For each of these three groups, correlations were computed 
between test scores and first-quarter honor-point ratio. Multiple 
correlations and prediction equations wore then computed and 
measures of statistical significanco obtained. 

This first part of the study was completed after the end of the 
fall quarter. At the end of the freshman year, a second analysis 
was made, based on three hundred seventy-two students. 
Included in this group wci*e seventy-six cases not included in the 
first analysis and omitted were five who had previously been 
included. Not all of the tests included in the first analysis were 
included in the second, those testa which had no or little pre¬ 
dictive power for fall-quarter honor-point ratio being omitted 
from the latter analysis. Tho additional cases %vcre those 
students who had taken all of the testa included in the lallcr 
analysis but who had been omitted during the finst analysis 
because some of the tests used then were not available. In the 
case of sixty students who had left school before tho end of tho 
year, all the grades obtained up to tho time of their leaving wore 
used in. determining honar-point ratios. Of these sixty students, 
twenty-nine left during the first quarter, twenty-five during tho 
second quarter, and six during the third quarter. These sixty 
students had mean high-school percentile ranks and honor-point 
ratios which were significantly lower than those for tho students 
who remained in school. The differences between means of tho 
two groups on the G.E.D. Test, the mathematics test, and tho 
Paper Form Board were not significantly different. 

This group of three hundred seventy-two students was 
treated as a whole and not broken into the curricular groups as 
had been done in the first analysis. 

For this group, correlations were computed between first- 
year honor-point ratio and high-school percentile rank, Coopera¬ 
tive Mathematics Test, G.E.D. Test III, and tho Paper Form 
Board. Multiple correlation coefficients and regression equa¬ 
tions were then obtained and the significance of the beta coef¬ 
ficients determined. Correlations were also computed between 
specific test scores and grade averages in mathematics, chemistry, 
and drawing, for all those students for whom both the grades in 
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each of these areas and the scores on each of these tests were 
available. 


RESULTS 

The zero ordot correlation coeflicienls between the variables, 
as determined at the end of the fall quarter, are presented in 
Table 1. These wore utilized in determining the multiple cor¬ 
relation coeflicienta between all the testa and honor-point ratios 
for each of the three groups. These multiple coefficients were: 

Group I .79 Group II .06 Group III .66 

All three multiple correlation coeflioicnta were significant at 
the one per cent level of probability. The beta coefficients for 
each variable were then tested for significance and the significant 
ones found to be: 

Group I—ITigh-school rank significant at one per cent level 
G.E.D. HI significant at five per cent level 
Group II—High-school rank significant at one per cent level 
G.E.D. HI significant at one per cent level, Cooperative 
Math, significant at one por cent level, Paper Form Board 
significant at five per cent level 
Group HI—High-school rank significant at one per cent 
level, G.E.D. Ill significant at five per cent Jovol 
For each of these groups, these variables, with the exception of 
the Paper Form Board, were re-combined and the following 
regression equations obtained: 

Group I 

Y, = -1.0488 + .0179Xi + .0144X2 Ry.XiX2 = .74 

Group II 

7, = -1.7211 + .OlSlXi -h .0137Xs 

-f- . 0249 X 3 By.XiXaXs = .64 

Group III 

Yo = -.9939 + .0132Xi + .0245Xa Uy.X.X^ = .66 

7, = fall-quarter HPR.; Xi = HSR; X 2 = GED; and X 3 == 
Coop. Math. 

The multiple R’s and the beta coefficients wore all significant 
at the one per cent level of probability. 

The zero order con’clations between the variables as determined 
at the end of the first year are presented in Table 2. 
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Table 1.—iNTERGORRELATIONfl BETWEEN TeST ScORES AND 
Fall-quarter Honor-point Ratiob for Each 
OF THE Three Groups 

Group I (chemistry and chemical engineering majors) N = 66 
HPR HSR GED Math Eng Chem ACE PFB 


Mean 

1.30 

80,31 

64.65 62.38 

182.92 41.03 

98.19 

49.89 

SD 

.71 

16.32 

11.86 

8.41 

41.69 

13.68 

23.04 

6.72 

PIPR 


.63 

.60 

.69 

.49 

.60 

,53 

.17 

HSR 



.40 

.41 

.38 

.20 

.47 

-.02 

GED 




.62 

.47 

.48 

.00 

.22 

Math 





.61 

.49 

.04 

.27 

Eng 






.41 

.69 

.20 

Chem 







.33 

.20 

ACE 








.26 


Group II (other majors with high-school chemistry) N = 189 
HPR HSR GED Math Eng Chem ACE PFB 


Mean 

1.19 

76.76 60.33 49.64 

163.43 

31.37 

88.05 49.40 

SD 

.69 

17.78 11.67 

7.63 

38.12 

11.00 23.22 

7.04 

HPR 


.60 .47 

.48 

.30 

.33 

.30 

.29 

HSR 


,34 

.32 

.36 

.28 

.37 

.13 

GED 



.46 

.46 

.43 

.60 

.34 

Math 




.49 

.33 

.60 

.29 

Eng 





.32 

.66 

.27 

Chem 






.33 

.07 

ACE 







.28 

Group III (other majors without high-school chemistry) N = 47 


HPR 

HSR GED 

Math 

Eng 

Chem 

ACE 

PFB 

Mean 

1.03 

66.19 47.46 40.78 

165.72 

14.49 

86.50 

60.64 

SD 

.78 

22.37 10.79 

6.66 

45.36 

7.33 

26.20 

6.44 

HPR 


.45 ,42 

.34 

.26 

.22 

.21 

.21 

HSR 


.21 

.31 

.35 

-.13 

.37 

.03 

GED 



.31 

.42 

.26 

.48 

- .06 

Math 




.33 

.08 

.31 

.24 

Eng 





.02 

.80 

-.05 

Chem 






.20 

.10 

ACE 







.01 


SD = standard deviation 

HPR = total honor point ratio at end of fall quarter 

HSR = high school percentile rank 

GED = General Educational Development Test III 

Math = Cooperative Mathematics Test 

Eng = Cooperative English Teat 

Chem = Cooperative Chemistry Teat 

ACE = American Council Psychologieal Examination 
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Table 2.—Intercohrelatiohs between Test Scobes and 
First-vear Honor-point Ratios H = 372 



HPR 

HSR 

GED 

Math 

PFB 

Mean 

1.16 

76.11 

60.69 

49.80 

49.67 

SD 

.67 

18.89 

11.62 

7.64 

6.96 

HPR 


.60 

.46 

.41 

.23 

I-ISR 



.33 

.27 

.10 

GED 




.43 

.23 

Math 





.29 


Multiple correlation coefficients were computed for several 
combinations of variables. 


= .63 
~ .62 

RY.XiXi = .69 
Ry^XiXiXt = .69 
Ry,XtXi = M 

Ry,XiXi = .63 

where Ye = first year honor point ratio 
Xi » high school percentile rank 
Xi = GED Test III 
Xi =* Cooperative Mathematics Test 
X 4 = Paper Form Board 

The regression equation resulting from the best combination of 
variables was computed and both the multiple correlation coef¬ 
ficient and the beta coefficients found significant at the one per 
cent level of probability. 

Ye = -.83785 4- .01289Xi + .01410Xa + .01S39Xa 
Correlations between scores on separate tests and first-year 
grades in special areas were: 

Mathematics grades with Cooperative Mathematics Test, 
r = .43, N = 410 

Chemistry grades witli Cooperative Chemistry Test, 
r = .42, N = 411 

Engineering Drawing grades with Paper Form Board, 
r = .36, N = 404 
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CONCIitJSIONS 

As has been found in plevious studies, the best single predictor 
of over-all grade average in college was here found to bo rank in 
high-school graduating class. This was true for three separate 
groups in terms of first-quarter grades and for the total group in 
terms of first-year grades. An almost equally efiieient prediotor 
is provided by the General Educational Development Test which 
predicts honor-point ratio in each group almost as well ns high- 
school rank does. In each case, these two predictors, high-school 
rank and G.E.D. Test, wei-e included in the optimal prediction 
battery. 

In two cases, that of the fall-quarter honor-point ratio pre¬ 
dictions for chemistry and chemical engineering majors and that 
of the first-year honor-point ratio prediction for the entire group, 
the Cooperative Mathematics Test contributed to tlie prediction 
sufficiently to warrant its inclusion in the battery. 

The variables included in this study do not provide predictions 
of greater accuracy than those which havo boon reported in the 
past. With the exception of the G.E.D. Tc.st, tho types of tests 
here used are similar to those used in the past. More accurate 
predictions might be obtained by using additional typos of tests—• 
tests of aptitude, interest, and x»crBonality. As an effort in this 
direction, the freshmen entering the Institute of Technology in 
the fall of 1948 were given the Differential Aptitude Tests, and 
the results obtained with theso will be reported soon. 
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BOOK REVIEWS 


Hubert Sorenson. Psychology in Education. Second Edition. 

New York: McGraw-Hill Book Co., 1948, pp. 535. 

'‘Much of the first edition has been completely rewritten, some 
material omitted entirely, and new material added. The 
remainder, with the exception of a few pages, has been carefully 
revised. A chapter on mental health of the teacher and one on 
basic motives have been added.” The basic plan of the second 
edition and apparently the author’s conception of the purpose 
and function of educational psychology are essentially the same 
as the first edition. 

The book contains an abundance of experimental material and 
is clearly and interestingly written. For these reasons it should 
appeal both to instructors and students. It is written more or 
less from the standpoint of traditional educational psychology 
texts; but from this standpoint it is quite up to date. It should 
appeal especially to instructors who take this approach to the 
subject. It is definitely superior to mo.st books of its kind. 
It may prove not to make so strong an appeal to instructors who 
like the child development frame of refei'ence and-approach the 
subject from that angle. 

The twenty-two chapters arc distributed as follows: three, to 
physical, mental and social growth; four, to motivational and 
adjustive aspects of the subject; four, to intelligence—its meas¬ 
urement and correlates; six, to traditional topics of learning and 
memory, including individual differences, motivation, transfer 
and theory; one, to work and fatigue; two, to teaching methods 
and study skills; and two to measuring and reporting educational 
progress. J. B. Stroud 

State University of Iowa 

Helen Shactbr. TIou) Personalities Grow. Bloomington, III.: 

McKnight and McKnight, 1949, pp. 256. 

The great appeal of an earlier book designed to foster more 
adequate adjustment of persons at the high school age led to the 
present treatise. The older book has been radically revised, 
concepts added and new material incorporated. The discussions 

IQl 
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are no longer limited to a particular age group. They apply to 
adults as well as to adolescents. 

The introductory material ia concerned witli personality 
patterns and likenesses and differences among personalities. 
This is followed by explanations of various social and sexual 
needs such as desire for approval, for auecess and the like. After 
noting how we frequently fail to satisfy needs and the resulting 
frustrations, various tccimiquas employed for evading rather 
than for solving problems arc explained. These include rationali¬ 
zation, retreat from reality, aggressive behavior, illness and 
others. The book ends on the theme that successful living is 
social living. Procedures by which one may come to understand 
the bases of difficulties in adjustment are outlined and suggestions 
given for more adequately playing the game of living. 

This book, since it is planned tor the individual in the general 
population rather than for the professional worker, is iieceBsarily 
elementary. It is written in a clear and interesting stylo, is well 
organized and can be of great help to those at higli flchool and 
young adult ages. Furthermore, parents and school counselors 
will find it very helpful in dealing with older cliildrcn. It seems 
to the reviewer that the material is somewhat hotter for under¬ 
standing behavior patterns in relation to personality adjustment 
than in furnishing hints for the readjustments needed, 

Miles A. Tinker 


University of Minnesota 
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TRAITS OP PERSONALITY AND THEIR INTER¬ 
CORRELATIONS AS SHOWN IN BIOGRAPHIES^ 

EDWAED L. THORNDIKE 
Professor Emoritus, Teachers College, Columbia University 

I have studied one or more biographies of each of the men 
listed below, including' thirty-four writers, twenty-three states¬ 
men, lawyers and labor leaders, fifteen business men, including 
two who were also inventors, nine military men, five scientists 
and/oc inventors, three medical men, one clergyman and one 
monarch. 

Writers: Barrio, Bennett, Browning, Burns, Byron, Carlyle, 
Coleridge, Cooper, Dickens, Havelock Ellis, Eugono Field, 
Fielding, Anatole Franco, Gissing, Goethe, Thomas Hardy, 
Hawthorne, Housman, Irving, Samuel Johnson, Lamb, Landor, 
Melville, Poe, Scott, Lincoln Steffens, Swinburno, Tennyson, 
Thackeray, Thoreau, MarlcTwain, Wells, Whitman, Wordsworth. 

Statesmen, lawyers and labor leaders: Bismarck, Bradlaugh, 
Brandeis, Carlisle Cleveland, Coolidgo, Debs, Disraeli, Franklin, 
Alexander Hamilton, Harding, Hay, House, Andrew Jackson, 
Jefferson, Lincoln, Lloyd George, Ramsay Macdonald, McKinley, 
Tom Reed, T. Roosevelt, Carl Schurz, Webster. 

Business men: John Jacob Astor, Carnegie, Jay Cooke, East¬ 
man, Fi'ick, Gary, Hanna, E. H, Harriman, T. J, Hill, Cyrus H. 
McCormick, J. Pierpont Morgan, Leland Stanford, Cornelius 
Vanderbilt, Wanamaker, Woolworth, 


‘ The study reported hero occupied my father during the last year of his 
life. He was working on it up to the timo of his death. Part of the manu¬ 
script was certainly written during the week before ho died and it is, as 
tho reader will seo, incomplete, It is published hero without addition or 
ohaiigo except for one or two explanatory footnotes. It represents his 
final legacy to psychology as an ompirical, experimental scienoe. [Robert 
L. Thorndike] 
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Military men; Grant, linig, Hindeiiburg, Kitchener, Lee, 
Napoleon, Sherman, Washington, Wellington. 

Scientists, inventors, and medical men: Darwin, Edison, Lord 
Kelvin, C. H. Mayo, W. J. Mayo, Newton, Osier, rnstcur. 

Henry Ward Leecher, William II of Germany. 

In computing the correlations I have included also ratings of 
nine persons well known to me, making one hundred in all. 

I have rated each person for each of llm traits listed below 
on a scale running —3, —Zyi, —2, —1H> -fH, +1, 

4 -2, 4-2 Hj +3 in terms of standard deviations from the 
median of the white males of the United States. The traits were 
chosen to include those reported on by Cyril Burt, some of those 
reported on by the author, and the ‘factors' regarded na important 
by the GuilCords. I found myself unable to rate these men for 
Cattell’a ‘factors,’ perhaps because I did nob fully understand 
them, I did not try to use his thirty-five trait clusters because 
of the labor involved. Probably I should have made the cITort. 

Traits chosen especially for comparison with Burt: general 
emotionality (1), curiosity (4), worry (8), fear (0), anger (7), 
joy (15), sadness (9), sociability (11), sexual proclivity (17). 
The numbers here and later identify the traits in the correlation 
table (Table 1). Traits chosen especially for comparison with 
Thorndike: intclligcnco (2), craving for approval (10), dominance 
(12), liking for conflict (13), shyness (28), display (20), and the 
degree of liking for each of the following: things (80), people (31), 
animals (32), plants (33), children (41), words (34), reading (35), 
art, music, and beauty (37), bodily exorcise (38), talking (42), 
eeclentary games (45), responsibility (40), system (38), neatness 
(39), such indulgences as eating, drinking and smoking (43). 

Traits chosen especially for oomparison with Guilford factors: 
rathymia (19), objectivity (20), cooperativencss (21), general 
activity (22), inferiority complex (23), N of Guilford or nervous¬ 
ness (24), agreeableness (25), depression (26). 

Other traits: motor ability (3), sensitiveness (6), affection 
(18), unselfishness (16), cruelty (14), sanity (27), relative strength 
of the likings for female society and for malo society (44). 

For special reasons I have made estimates also of (46) parental 
wealth at the time tlie man was ago zero to fiftoon, (47) degree 
to which the father or male head of the household indulged the 
boy, and (48) degree to which the mother or female head of the 
household indulged him. 
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When the household had no male head, I have arbitrarily 
entered the degree of paternal indulgence as at the median of 
that of the United States population. 

I did not expect to discover much of value from my ratings 
when I began the work and my ©xpectatione grew less as it 
progressed. Modern biographers of the realistic school do 
try to include events that show the man's total personality as 
well as his career as a specialist, and an instructive volume could 
be composed of cases of trait x in person y, evidenced by y’a 
actual behavior. But they leave many gaps. 

The validity of the ratings consequently varies from very high 
as for sex in Byron, unselfishness in Pasteur, talking in Coleridge, 
agi'ceableness in Jay Oooke, or shyness in Theodore Boosevelb, 
to very low as when the only basis for rating a person in the 
trait is that the person was probably ordinary with respect to 
it because the biography gives no facts or opinions concerning 
that trait. This is not a safe assumption. If I had not used 
only men for whom recent and realistic biographies containing 
fairly detailed personal histories were available, many more 
of the ratings would have been little better than guesses. Taking 
them at their face value we have the intercorrelations of Table 1. 

Any one of those correlations can be explored further by using 
only those men in whom the two traits in question have fairly 
dependable ratings. I intended to do this, but I cannot. My 
ratings were often made without written notes of the evidence 
supporting them. At the time it scorned sure that I would 
remember what it was, and my memories (at age seventy-five) 
are failing rapidly. Nor have I the strength to review the 
written notes I made when reading the biographies. So I leave 
the interoorrelations of Table 1 for what they may be worth, 
and append the ratings of the ninety-one biographies for— 
variables which are at least mostly better than mere chance for 
the use of any psychologist making similar studies. I hope the 
weakness of my study will not discourage them.* 

Anybody can adduce many reasons why this way of studying 


* Apparently my father inlondcd to estimate reliabilitioa of the ratinga 
for the different traits by re-rating the individuals after a period of time. 
Some work shoots on this aspect of the study wore among his papez-a. liow- 
ever, it was not comploted, and so it is imposaiblo to select particular traits 
to be reported. The complete table of ratings for the ninety-one individuals 
and forty-eight traits is appended to this report. (R. L. T.] 
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the problems of personality is defective, but it is at least different 
from the ways hitherto taken and has the merits of using life 
histories available to all students of behavior. Facts could bo 
adduced to show that the methods used by Burt, the Guilfords, 
and Cattoll are defective also. There is in fact no royal road to 
dependable inventories of personalities especially after early 
childhood. I now think that the most promising practicable 
way is for each of fifty or more psychologists to rate ton or more 
adults intimately known to him on each of an agreed upoir list 
of traits on a scale representing the total United States white 
adult population, Some foundation should then pay to have 
two sets of intercorrelationa computed for each of the fifty or 
more sets of measurements, one using the alleged divergences 
from the United States means, the otliev using the divergences 
from the actual means of each psychologist’s group. The former 
can be combined into an average inloreorrelation table (after 
zeta transformations) whose values are unduly raised by the 
fifty psychologists' errors in estimating the United States avoragoa 
and variabilities. The latter can be combined into a second 
average intercorrelation table whoso values are unduly lowered 
by restricted range. Taken together these two tables would, 
however, be far better than all that we now have on the inter- 
correlations of fear, anger, dominance, pugnacity, aociability, 
display, shyness, etc., etc. in adults. 

Because the correlations of Table 1 are in part due to the large 
proportions of (1) writers, (2) atafcesmen, and (3) business men, 
and because there are group differences especially between the 
writers and others, I give in Table 2 the means for the different 
groups. The group diffevencea are le^ than popular psychology 
supposes to be the case and there is always much overlapping. 

, I call attention to certain matters in Table 1. 

It gives some support to Burt’s belief that something that 
may be called general emotionality exists and that it is a char¬ 
acteristic of juvenile offenders. In our data it correlates —.11 
with intellect, —.19 with unselfishness, —.54 with objectivity, 

— .34 with coSperativeness, —.43 with sanity, —.31 with system, 

— .16 with neatness, and —.26 with responsibility. It has 
positive correlations of .30 or more with sexual proclivity, 
rathymia, inferiority, N, display, and. liking to talk (but also 
with agreeableness). 
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37. Liking for art, music, and beauty 11.9 9.6 11.7 9.3 10.3 

38. Liking for system 6.5 8.1 8.2 8.9 8.7 

39. Liking for neatness 6.6 7.7 7.8 7.9 6.7 
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It gives support to the hypothesis that fear and anger are inde¬ 
pendent gene-caused traits in man. The correlation is — .14; and 
Burt found a similar slight negative correlation as an exception to 
his general view of emotional linkages.^ 

[footnote for ArPBNDDC] 

In tho ratings given here, with certain oxcoptiona which will bo noted, 
the integers correspond to half standard deviation units of tlie distribution 
of white males in the United States, while tho median of this distribution is 
represented by tho number 7. Tho exceptions arc ns follows; 

Variable 4- Gwiosily. This is a composite of two separate ratings. 
It is expressed so that the neutral point is 12, and its standard deviation 
in the population would bo more than 2. 

Variable 37. Liking for art, music, beauty. Also a composite. Indiffer¬ 
ence point 10.0, and standard deviation greater tlian 2. 

Variable 10. Craving for approval. Tho number scale has been shifted 
so that tho presumed population median for this variable is 3. 

Variable 19. Ralhymia, Number scale shifted so that presumed popu¬ 
lation median is 6. 

Variable £3. Inferiority. Number scale shifted so that presumed 
population median is 6. 

* At this point the manuscript comes to an end. It is clearly unfinished, 
but I do not know on what further aspects of the data my father intended 
to comment. The results are now available to all for such further analysis 
and interpretation as they may care to make, [R. L, T.] 



CAUL E. SEASHORE 
1866-1949 

Experimental methods were introduced in the study of human 
behavior during the latter part of the Nineteenth Century. 
The first psychological laboratory was established in 1879 by 
Wilhelm Wundt at the University of Leipzig. Immediately 
thereafter American universities followed with the founding of a 
score of psychological laboratories befoi*o the end of the century. 

During the next fifty years psychology as a science grew from 
an infant to a husky youth. At first emphasis was largely on 
sensory and perceptual processes as measured by motor responses 
and reaction times. Very soon, however, the field broadened. 
Interests of investigators expanded enormously to cover a wide 
variety of aspects of human behavior and social relations: 
learning and growth, aptitudes and interests, motivations and 
incentives, attitudes and opinions, intelligence and personality. 
Ventures into these new fields called for refinements in method 
and particularly the application of statistical techniques. 

Furthermore this firat half of the Twentieth Century is also the 
period during which American universities overtoolc European 
centers of learning and rose to world leadership in research. 

Carl E. Seashore’s adult life span coincided with this half cen¬ 
tury of the flowering of research in American universities. The 
uniqueness of his contribution is the combination of outstanding 
achievement and leadership (1) not only in his own field of 
psychology as an investigator and guide of the graduate work of 
numerous students, but (2) also in the over-all field of graduate 
research at the University of Iowa in sotting high standards of 
attainment. 

For forty years he was director of the psychological laboratory 
and for thirty of these years he was also dean of the graduate 
college followed by a decade of semi-retirement devoted to 
research and writing. Coming almost immediately, after his 
graduate studios at Yale, to Iowa in 1897, his half century of 
teaching, research and administrative leadership is unequalled at 
the University of Iowa and probably seldom matched anywhere 
else. 

Dr. Seashore came from sturdy pioneer stock and carried these 
same qualities into his pioneering in psycJiology, He was born 
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in Morlunda, Sweden, January 28, 1866. When three years 
old his family moved to the United States and settled in Iowa. 
He was graduated from Gustavus Adolphus College, St. Peter, 
Minnesota, in 1891. Ho received his doctorate at Yale in 1896 
and after two years as assistant at Yale, ho came to tlie Uni¬ 
versity of Iowa to take charge of the psychological laboratory 
whose beginnings had been made by Profossor George T. W. 
Patrick. 

In his early years he invented the Voice Tonoscopc, the Audio¬ 
meter, and the Sound Perimeter. Among his chief contributions 
to psychological science was his development of a system of 
analysis and measurement of musical aptitude as a basis for 
vocational guidance in music, Another of his major achieve¬ 
ments was the establishment of the Child Welfare Research 
Station. 

Through Dean Seashore’s vision and persevei'ance, the Iowa 
psychological laboratory became one of a small handful of top- 
ranking laboratories, both in research contributions and in 
training outstanding professional leaders. 

He was a member of Sigma Xi and a fellow of tho American 
Psychological Association of which he was president in 1911. 
In 1920 he was chairman of the division of Psychology and 
Anthropology of the National Research Council. He received 
many honors and recognitions. In 1948 the Board of Education 
of the state of Iowa conferred upon him the title of “Distin¬ 
guished Service Professor.” 

Dr. Seashore died on October 16, 1949, only two months after 
his wife had passed away. Always closely tied to each other and 
supplementing each other’s interests, their home and family were 
their delight and satisfaction. Only those who were privileged 
to come under his guidance and sense the philosophy tlint 
permeated his work and his home, can fully appreciate his worth 
and influence. Daniel Staucii 

Daniel Starch and Staff 

New York 17, New York 



NOTES ON THE MEASUREMENT OF MENTAL 

SPEED 

MERLE W. TATE 
University of Pennsylvania 

Menial speed or rate of performiag intellectual tasks has long 
been of interest to psychologists. The two most persistent 
issues—and they are related—^have been whether mental speed 
is independent of dif&oulty and type of task and whether it is 
indicative of profundity or altitude of intellect, accuracy or 
quality of work, temperamental factors, achievement in school, 
and vocational success. 

The inconsistencies and contradictions in the voluminous 
literature suggest either that speed is an -unstable dimension of 
intellect or that inappropriate units and methods of measuring 
it have frequently' been employed. Regarding the latter possi¬ 
bility, it is easy to show that the findings in a number of studies 
may have been consequent to the method of investigation, rather 
than to the i’61e of speed. Substantial correlation of scores 
obtained from timed and untimed administration of group 
tests, in view of the part-whole circumstance, is inevitable— 
whatever the relation of speed to altiliide. The meaning of the 
significant inverse relationship between cumulative accuracy 
scores and total times spent on a test would bo expected due to 
the fact that inaccuracy or error decreases speed as well as 
cumulative accuracy scores. The equivalence of work limit and 
time limit scores on low difficulty tests is consequent to the 
definitions of the former as the average tinve required to complete 
an item and of the latter as the number of items completed in 
unit time. As defined, the measures obviously tend to be related 
as arithmetic and harmonic means. In some of the more careful 
studies, charactevized by timing each subject on each task, 
control of accuracy and use of statistical test, speed has been 
found to bo significantly corrolalcd with altitude, In others, 
it has been found to be uii.stal)lc, as ditlicully of task varies. 
These more careful studies, in general, have boon inconclusive 
because of extreme skewness and Uuik of homogeneity of variance 
of the speed measures or bccau.se of loss of independence of the 
measures when converted into scores based upon group per- 
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formance on each task, such as percentile ranks and deviation 
Boores. 

There is a steadily increasing body of evidence that speed of 
response, when appropriately measured, is a stable and inde¬ 
pendent ability. Factor analyses of the intercorrelations of 
scores on speeded tests of low dilRculty have consistently isolated 
a speed factor. Baxter/ Davidson and CarrolF and others 
have found the ability to be elicited by mental test materials of 
higher difficulty. In. the writer’s study® both a general speed 
ability and a special speed ability linked to function were found 
operative in response to four types of mental test materials of 
varying degrees of difficulty. 

The hypothesis of a general ability in speed, independent of 
mental altitude and independent of function in which it is 
observed appears to be tenable. The ability has been observed 
in the testing situation, and, since this situation tends to equalize 
motivation, the magnitude of the differences observed probably is 
at a minimum. Is it an important individual difference? At 
present, little is known about its nature or its corrolatives. It 
may be a native trait. It may be a set for a particular rate of 
work. A number of factor analysts have concluded that the 
factor, as elicited by low difficulty tasics, either is an ability or a 
readiness for discovering and identifying perceptual detail. If 
so, it may be inherent in the mental act itself, in a habitual way 
of going about a task, or in efficiency of use of mental power. 
Perhaps it is a basic component of that psychological complex 
kn own as temperament. 

Practically, however, these questions are not as important as 
the questions regarding mental speed correlatives. Do indi¬ 
vidual diffei'ences in speed set off occupational groups or success¬ 
ful workers within groups? Are there antecedent-consequent 
relations between, say, speed in verbal ability and success in 
occupations requiring the ready word and pen, such as lecturing 
and journalism? Is there a speed loading in school marks? 
Are there racial differences in speed? If speed is a basic com¬ 
ponent of temperament, dora it act as one of the determiners 
in the subtle process of selecting friends and mates? Is it 
associated with conservatism-radicalism attitudes? Is it related 
to persistence? Do individuals differ in variability as well as in 



Notes on the Measurement of Menial S'peed 


221 


mean speed in responding to a set of tasks, and, if so, does the 
difference in variability provide useful information? 

There are a great many provocative problems relating to the 
r6le of speed in behavior. It is the purpose of this paper to 
consider some of the difficulties which come up in the measure¬ 
ment of mental speed and to suggest methods of obtaining reliable 
measures of it. 


METHODS AND MATEMALS 

Among the kinds of studies of particular interest and impor¬ 
tance are (1) the selection of tasks which reliably tap speed, 
(2) the effect of experimental treatments upon speed, and (3) the 
correlatives of speed. The first, of course, is basic to any study, 
and it requires that each individual in the sample under investiga¬ 
tion bo timed on each task. Individual timing eliminates 
irrelevant time loss duo to search for attractive items and failure 
to complete undertaken tasks, permits control of the effect of 
inaccuracy, and provides data for precise study of reliability. 
Total times on tests in group situations may provide useful 
information for some purposes, but they do not provide a satis¬ 
factory, basis for individual comparisons. They tell little about 
how time ia spent and nothing about variability within the 
individual. 

For several reasons typical intelligence test items are well- 
adapted to studying speed of response. These items tend to 
require from about eight to forty seconds, on the average, from 
the individuals for whom they arc designed; they are relatively 
free from familiarity and practice effects; and they can be 
selected so as to tap reliably a number of partially independent 
functions. Shorter items are proportionately more affected 
by errors in timing and time differencos ascribablo to different 
rates of reading the stimulus material and indicating the response, 
while the pro))abiUty of lime loss due to gross irrclcvancics tends 
to bo greater in the longer. 

There likely are many other sortH of papor-and-pcneil and 
performance tasks which would prove, we.U-iulupte.d to particular 
problems, h’or example, extensive .sets of arillimolic exorcises 
or monotonous manipulatory tnskw might bo found ai)propi’ifttc 
for determining whether variation in speed of response during 
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long and tiring periods of work can bo assooiated with, say, 
persistence. 

It is reasonable to surmise that the tasks should be of comple¬ 
tion rather than of multiple choice type, since time pressure 
likely tends to increase guessing. The relation of speed to 
motivation in an individual, in general, probably is very close; 
in fact, if it were possible to obtain a sort of average speed index 
for an individual, based upon performances under varying 
degrees of motivation, it might be possible to study motivation 
quantitatively. Be that as it may, it seems evident that the 
individual subjects in a speed study should bo working for speed 
and accuracy, under the most comparable motivating conditions 
possible. 

AN APPROPRIATE UNIT OF MEASUREMENT 

When a number of short, homogeneous tasks are individually 
administered and timed in seconds, the distributions of time 
scores of the individuals in the sample will be characterized by 
severe nonnormality and heteiugcneity of variance. TJie 
development of precise statistical tests applicable to such dis¬ 
tributions is a matter of great complexity, if possible at all. 
Thus, the average investigator must either forgo exact statistical 
analysis of the speed meosuius or must find a method of miro- 
ducing normality and homogeneity without destroying the 
independence of the measures. 

In his examination of a random sample of the distributions of 
speed measures of thirty-six high-schooi students on arithmetic 
reasoning, number series, sentence completion and spatial rela¬ 
tions tests, the writer® found the common logarithms of the 
times in seconds to be distributed normally with acceptably 
homogeneous variance, as judged by the Chi-square and Li 
criterions. Each test contained about sixty items of mainly 
twenty to sixty per cent diflRculty, in terms of percentages failing. 
Since that study, the writer has examined a great many sets of 
response times and has found that talcing the common logarithms 
of the times in seconds has always improved the normality and 
has usually improved the homogeneity conditions. 

It is pertinent here to examine the ‘raw' time and log time 
distributions of several samples of individuals on various kinds 
of tasks. The distributions in Table I are based on Peak’s and 
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Boring’s report^ of the results of adimnaatering Porms A and B 
of the Otis Self^Administering Test of Mental Ability, Higher 
Examination, to two male and three female university students. 
The investigators report only the rounded number of seconds for 


Table I.— Distributions of Correct Response Times in 
Seconds and Log Seconds of Five University Students 
ON Otis Mental Test-items 
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the suhiccts on the items all worked correctly. (Subject D 
spent 400 seconds on one of the items. That s<iore is not included 
in the Table.) Common logavithma with tsvo place mantissas 
were taken of the times in seconds and multiplied by 100 to 
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eliminate decimals. For the sake of table compactness a uniform 
grouping scheme is employed in forming the distributions. 
Where rounding to the nearest second could affect the log scores 
to the extent of changing class membership, the log scores are 
assigned proportionately to the classes affected. Considering 


Taelp IL—DisTRiBUTiONa OP Correct Response Times in 
Seconds and Log Seconds op Pour Higii-sciiool Seniors 
ON Minnesota Paper Form Board Items 
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2 






170-179 

D 

□ 

1 

1 






180-189 

D 

I 

1 



* Cominon logarithms of the times in seconds, rounded to two-place 
mantissas and multiplied by 100. 


the raw time distributions for Subjects A and E, which appear 
least similar, the ratios of Fisher's gi and g 2 statisbics® to their 
standard errors are about 11 and 15 and 8 and 9, respectively. 
In the log distributions, the ratios are .9 and .3 and .8 and .5. 
The effect of the log transformations on the variances is very 
marked. The F-ratios of the raw time variances for Subjects A 
and E is 2.26; that of the log time variances, 1.17. A ratio of 
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about 1.59 is significant at the one per cent level. It is interesting 
to note that Peak and Boring, after transforming the times of 
response by taking “ 1000 time the I'atio of the time of one subject 
to the total time of the five subjects on any item’^ observed a 
difference between the mean times of Subjects A and E of about 
11.9 times its standard error. Based upon the log measures, 
the critical ratio is about 4.3. 

Table II gives the distributions of raw and log times of correct 
response of four college preparatory high-school seniors to the 
sixty-four items of the Minnesota Paper Form Board, Form. A, 
test. Two of the foui' subjects were ^rls. All were of superior 
academic aptitude and of approximately the same chronological 
age. The improvement effected by the log transformation is 


Table III.— Pooled Distbib-utions oy Cokeect and Incorrect 
Response Times in Seconds and Log Seconds oe Five 
Higu-sciiool Girls on Thirty Sentence Comtletion 
Items* 

Time in Correct incoweefc Time inf Correct Incorrect 
Seconds Response Response Log Seconds Response Response 


0-8 

17 

5 

26-38 

1 


9-17 

36 

14 

39-51 

2 


18-26 

18 

8 

52-64 

2 


27-35 

13 

10 

65-77 

3 

1 

36-44 

3 

5 

78-90 

7 

3 

45-63 

2 

1 

91-1Q3 

13 

3 

54-62 

1 

1 

l(kH16 

15 

7 

63-71 

2 

3 

117-129 

17 

8 

72-80 

1 


130-142 

11 

5 

81-89 



143-155 

13 

10 

90-98 



156-168 

5 

5 

99-107 


1 

1C9-181 

2 

3 

1Q8-U6 


2 

182-19-1 

2 

2 

117-125 



195-207 


3 

120-134 


2 

208-220 


3 

135-143 


1 





♦Twenty of Iho ilcnxa arc reptoiUicctl in Table YIt. 
t Common lognriLhms of the limes in seconds, rounded to two-placo 
mantissag and multiplied !>y 100. 
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l^isl ob^erv^blo in the case of Subjeoi; 4. For that subject’s 
raw tifflo distribution, the rafciM of gi and gt to their standard 
errors ore 8.4 nnd 2.6, respectively; for the log time, .2 and .1. 
Only twenty-eight of the Bixty-four items in the test were 
responded to oorrectly by all four subjects, and, since the items 
varied greatly in length, comparisons of means and variances 
cannot ho appropriately made. 

The distributions in Table III were obtained from a study of 
tlve speed of response of thirty high-sehool girls to tlilrty CAVD 
type sentence completion items.* The moans and variances of 
the log times for five of tlie girls wei^e approximately equal, and 
the distributions of the five were pooled. The five were enrolled 
in other than college pi'Gpamtoiy curricula, and their IQ’s were 
97, lOO, 102, 107 and 109, The Table contains four fewer than 
the possible number of scores, due to failures to respond. 

Table IVt gives the pooled raw and log time distributions of 
correct and incori.'ect response of ton married pairs to thirty 
CAVB type sentence completion items. (On eleven occasions 
atoms were passed without response, and nine of the limes foil 
between S5 and 134 secunds. The nine wore deleted for the 
sake of table compactness.) In terms of percentages failing, 
the mid-measure of item difGculty was fifteen per cent; the firat- 
and third-quarter measures were five and thirty-five per cent, 
respectively. The majority of the variunuea of the twenty log 
time (listributions were acceptably homogeneous, and the moans 
were distributed normally. The pooled log time distributions 
in Table IV appear to be riie sort expected, under the ciroum- 
stancBS, in sampling from normal parents. In the distribution of 


* Ill the adminiBtratioii of the sentence oomplotion items, a screening 
•device which could bo slipped down the pages of items was used. In deter¬ 
mining a subject's speed of response to an item, tho wntoh was started at 
tho instant tJio screen came to rest, disdosing the item, and stopijed at tho 
Instant tlio subject filled iii the last blank of Uiat item. 

11 am indebted to Miss Mildred Muenoh of tho Clinton, Now York, 
Central School for the data sumraariaed in Table III and to Mr. J. B. Ellery, 
now (it the University of Colorado, for tho data in Tnblo IV. The former 
had investigated tho r6le of speed of response in fifteen pairs of close girl 
friends; and bho latter, its rdk in ten young married coiiplOB. The former 
found tbfl between pair speed varianee to be greater than tho within pair 
Variance at about the five per cent level of significance; the latter observed 
' slgnifioanco at about the three per cent levsl. 
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Table IV.— Pooled DiSTRisimoNS of Correct and Incorrect 
Response Times in Seconds and Log Seconds of Twenty 
Adults on Thirty Sentence Completion Items* 


Time in Correct Incorrect Timeint Correct Incorrect 
Seconds Response Response Log Seconds Response Response 


2-4 

56 


30-39 

7 


5-7 

91 

9 

40-49 

7 


8-10 

108 

10 

50-59 

18 


U-13 

66 

10 

60-69 

31 


14-16 

50 

13 

70-79 

42 

5 

17-19 

29 

10 

80-89 

67 

6 

20-22 

20 

14 

90-99 

58 

6 

23-25 

15 

9 

100-109 

77 

9 

26-28 

7 

6 

110-119 

62 

14 

29-31 

7 

3 

120-129 

41 

17 

32-34 

3 

8 

130-139 

33 

16 

35-37 

4 

2 

140-149 

16 

12 

38-40 

4 

4 

150-159 

10 

11 

41-43 

2 


100-109 

8 

8 

44-46 

4 

3 

170-179 

5 

5 

47-49 

1 

2 




60-52 

2 

2 




53-55 

3 

3 





* Twenty of the items arc reproduced in Table VII. 
t Common logarithms of the times in seconda, rounded to two-placo 
mantissas and multiplied by 100. 


log times of correct response, the ratios of gi and g 2 to their 
standard errors are .9 and .6, respectively. Twenty of the 
thirty sentence completion items used in the studies from which 
the data of Tables III and IV were obtained are reproduced in 
Table VII. 

Not only do log times of response to a number of short, homo¬ 
geneous tasks tend to be distributed normally within the indi¬ 
vidual; the log times of a number oi individuals on a single task 
tend to be similarly distributed. The samples of individuals at 
hand arc too small to permit sidequate examination of the dis¬ 
tributions of log times of response to a single item. When the 
measures from several items having equal mean lengths and 
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acceptably equal vaj'iances are pooled, however, their cor¬ 
respondence to normal form is very evident. The distributions 
of log and raw times of response of the thirty girls to four such 
items are shown in Table V. Table YI contains the distributions 
of the ten married pairs on six items having approximately equal 
means of log times of correct response. Both talDlcs contain 

Table V.— Distributions op Correct and Incorrect 
Response Times in Seconds and Log Seconds op 
Thirty High-school Girls on Bour Comparajjle 
Sentence Completion Iteais 

Time in Correct Incormct Time in* Correct Incorrect 
Seconds Response Response Log Seconds Response Response 


0-8 

2 


70-79 

1 


9-17 

31 

7 

80-89 



18-26 

18 

14 

90-99 

2 

1 

27-35 

10 

10 

100-109 

8 

1 

36^4 

2 

9 

110-119 

12 

3 

4B-53 

1 

3 

120-129 

14 

6 

64-62 


1 

130-139 

10 

8 

63-71 

2 

3 

140-149 

10 

8 

72-80 



160-169 

5 

9 

81-89 



160-169 

2 

7 

90-98 


2 

170-179 


3 

99-107 


1 

180-189 

2 

3 

108-116 

1 

1 

190-199 

' 

2 




200-209 

1 

2 


* Common logarithms of the times in seconds, rounded to two-placo 
mantissas anti multiplied by 100. 

fewer than the possible number of scores due to failures to 
respond. 

The various distributions shown in Table I-VI have been 
selected as representative of the many possible distributions 
afforded by the samples of individuals and tasks in hand. They 
support the hypotheses that (1) times of response to mental test 
items, measured in log seconds, tend to bo normally distributed 
in the individual and (2) times of response on a single item, 
measured in log seconds, tend to be normally distributed in a 
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Table VI.— DiaTRiBUTioNS ot Coreegt and Incorbect 
Hbsponsb Times in Seconds and Loo Seconds or Twenty 
Adults on Six Comparable Sentence Completion 

Items 

Time in Correct Incorrect Time in* Correct Incorrect 
Seconds Hesponse Response Log Seconds Response Response 


5-9 

6 


77-85 

2 


10--14 

23 

5 

86-94 

3 


15-19 

14 

5 

95-103 

7 

1 

20-24 

12 

8 

104^112 

11 

2 

25-29 

5 

7 

113-121 

14 

3 

30-34 

4 

5 

122-130 

8 

6 

35-39 

2 

5 

L31-139 

11 

7 

40-44 

3 


140-148 

6 

8 

45-49 

3 

4 

149-157 

4 

7 

60-54 



158-166 

6 

3 

65-59 

1 


167-175 

2 

3 

60-64 


4 

176-184 


4 

65-69 



185-193 


1 

70-74 


1 





* Common logarithms of tho times in seconds, rounded to two place 
mantissas and multiplied by 100. 

group of individuals. The distributions of response times to 
sentence completion items have been utilized only in order to 
compare different samples of individuals. The writer^ found 
speed, measured in log seconds^ in arithmetic reasoning and in 
number series completion to be slightly better distributed with 
regard to normality and homogeneity and to discriminate 
between individuals in a sample of thirty-six more sharply than 
speed in sentence completion. The former two have the addi¬ 
tional advantage of being easily scored for accuracy on an all- 
or-none basis. 

The converse of a theorem that the distribution formed by 
pooling samples from a normal univer^i is normal would not 
necessarily hold. But where there arc no sj^sLemalie difi’crences 
with respect to normality between the samples, it is rca.sonablo 
to suppose that the variable is distributed normally in the popula¬ 
tions sampled. 
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The hypotheses appear to obtain for a 'wide variety of tasks 
from zero to at least about sixty per cent difficulty, defined by 
percentages failing, ond for a wido variety of individuals who are 
striving for both speed and accuracy in their performance. 
Performances on tests, however scored, obviously are affected by 
the individuals and the basics, but in view of the variety of 
individuals and tasks here under consideration, it appears 
likely that log time will prove a generally useful unit in measuring 
speed of response. 


conthoii op accuha-Cy 

Given appropriate tasks and units of measurement, the 
next requirement of a study of mental speed is provision for 
control of inaccuracy effect, which, the data of Tables III-VII 
indicate, tends to be substantial. 

If two or more individuals respond to the same tasks with the 
same degree of accuracy, their rates of work can bo compared 
simply and precisely. This ideal situation can bo made to 
obtain by retaining for an analysis only tJie response times on 
tasks which all subjects perform correctly. Such experimental 
control, though the soundest possible, has two disadvantages. 
First, in practical situations, it is likely to result in enormous 
loss of data. For example, thirty-six of the sixty-four Minnesota 
Form. Board items would be lost if the data of Table II were 
limited to items which all four subjects performed correctly. 
Second, since such tasks are of zero difficulty, they cannot be 
shown to be measuring anything except speed. Measures based 
upon them provide no information regarding rate of doing various 
kinds of work of varying degrees of difficulty. 

There are several statistical methods of controlling accuracy 
effect, at least two of which merit consideration. If approxi¬ 
mately equal length tasks, on an average, are available, such 
that all of the individuals in a sample perform two or more cor¬ 
rectly and two or more incorrectly (the more, of course, the 
better), a precise statistical control is possible. In tliis situation, 
mean times of correct and of incorrect response may bo com¬ 
puted and classified for conventional analysis of variation. 
The simplest classification would be a two array table and would 
permit tests of significance of accuracy and individual effects on 
mental speed in a particular function. Various extensions of 
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the design suggest themselves. If the tasks can be classified 
according to two or more levels of difficulty or two or more func¬ 
tions or two or more experimental treatments, a four or more 
array classification of the speed scores can be made. It will be 
noted that, provided the log times can be shown to be distributed 
normally with equal variance, the assumptions underlying 
variance analysis will be explicitly fulfilled. 

A second method of controlling accuracy effect consists in 
adjusting each response time or speed score for accuracy by 
regression procedure. In a single task, accuracy being scored 
‘0’ or '1/ the residuals from the regression line of speed on 
accuracy will be merely the difference between the scores and the 
mean of correct or of incorrect response, as the case may be. 
There will result as many r^dual or adjusted scores for each 
individual as there are tasks; and the mean of these will provide 
an unbiased estimate of the individual’s speed of response free 
from task and accuracy effects. This method, which the writer 
has more fully described elsewhere,® has the advantage of not 
obscuring the variability of the original measures, of providing 
control of possible systematic differences in length of task, and 
of providing a single measure of individual speed. Because of 
the latter advantage, the method will be particularly useful in 
studying mental speed correlatives. 

The question of whether speeds of correct and of incorrect 
response are homogeneous in an individual is an important and 
interesting one. Theoretical considerations suggest that if a 
task were unintelligible to an individual, the time of his response 
would have little meaning. They also suggest that different 
sorts of inaccuracies or errors wUl affect response times differ¬ 
ently. Empirically, the speeds do appear to possess homogeneity. 
The evidence indicates consistency in rates of correct and of 
incorrect response, in general, i.e., individuals tend to maintain 
their relative positions in rate regardless of accuracy, although 
there may be significant individual differences here, and, as a 
speculation, these may be important. 

Tins IlELrAllIlilTY OF SPEED MEASURES 

Both of tho’ above methods of statistical control of accuracy 
make it possible to determine whether the variation in speed of 
response between individuals is significantly greater than the 
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variation within individuals. The first method, however, sinoe 
it utilizes the means of correct and incorrect response times, 
obscures the variability of the original measures. It is possible 
that significance of differences in speed demonstrated by the 
method would not obtain if the original measures were given 
freer play. 

The second method provides the data for testing the significance 
of differences between estimated trae speeds of response, with the 
criterion or error variance, since it is the pooled variances of the 
adjusted scores within individuals, at a maximum. (It should 
be noted that the application of the method results in the loss 
of two degrees of freedom per item.) The test of reliability here 
is the simple one of determining whether the variation of the 
means of the adjusted scores is significantly greater than the 
variation of the scores within individuals, the assumptions being 
those of normality and of homogeneity of error variance. In 
his examination of sixteen sets of adjusted speed measures, the 
writer has found the first assumption generally tenable. The 
second assumption has generally been in doubt, although not 
suffioiently to invalidate variance-ratio tests. It appears 
probable that there are significant and possibly important 
individual differences in variability in mental speed. The 
possibility invites further investigation. 

The second method also makes it possible to estimate the 
reliability of single items. The correlation of adjusted times 
on an item with aggregate adjusted times on the remaining items 
will provide an index of the discriminating power or the reliability 
of the item as a measure of speed. 

The twenty sentence completion items entered in Table VII 
were common to the studies of mental speed in the three samples 
of individuals mentioned above. The samples differed in several 
respects. The median IQ in the sample of thirty-six, consisting 
of twenty-two boys and fourteen girls, was 110. The boys and 
girls wore enrolled in a college preparatory curriculum and all 
were of relatively favorable socio-economic background. The 
median IQ in the sample of thirty girls was 110. The girls were 
of diverse socio-economic backgrounds and were enrolled in, 
various curricula. The males of the sample of twenty adults, 
consisting of ten married pairs, were above the 60 percentile for 
college students on the Henmon-Nelson mental test and were 
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enrolled in a highly selective men’s liberal arts college. All 
were veterans. Nine of the ten wives had two or more years 
of college training, and all appeared to be of average or better 
intelligence among college women. 

Space does not permit inclnsion of the log time and accuracy 
scores of each individual on each item, but the statistics dei’ived 
from them are shown in Table YII. A rough estimate of the 
standard deviations of the log times of correct and of incorrect 
response, from which the means in the table wore derived, indi¬ 
cated that they fell between about 15 and 35. The standard 
errors of the means, consequently, range from about 2 upward, 
with the great majority lying between 5 and 10. Reliable 
differences in. both speed and altitude are indicated between the 
populations of high-school students and the population of adults 
represented by the samples. The differences between the 
populations of high-school students approach significance on 
few items, although the sample of thirty has a mean cumulative 
accuracy score on the twenty items of 12.2 against a mean of 
13.7 for the sample of thirty-six. The difference is about 2.6 
times its standard error. 

The extent of correspondence of the ways the items worked in 
tho three samples is interesting. Considering the samples of 
thirty and thirty-six, the rank-difference coiTclation coefficients 
between mean log times of correct response, between mean log 
times of incorrect response, and between item difficulties are 
.86, .75, and .76, respectively. For the samples of thirty and 
twenty, the coefficients between mean log times of correct 
response and between item difficulties are .85 and .72. For the 
samplos of thirty-six and twenty, the coefficients between mean 
log times of correct response and between item difficulties are 
.93 and .80. 

The item reliability coefficients shown in Table VII were deter¬ 
mined by rank-difference correlation of adjusted limes on each 
item with total adjusted times on tho twenty items. The 
majority of the coefficients in tlie two samples of high-school 
studeiit.H are significant. The differences between coefficients 
in the two samples arc such as would be expected in sampling. 
Only item 15 raises doubt. There, taking into account the 
loss of two degrees of freedom, the null hypothesis is discredited 
at about tho tlu'cc per cent level. In the sample of adults fewer 
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than half of the coeSicientB appear to bo significant, and several 
coefiicienta indicate significant differences between the population 
of adults and the populations of high-school students. All in 
all, however, the data of Tabic VIl indicate that item times are 
at least as stable as item difficulties. In sentence cojnplction, 
at least, the possibility of developing quite reliable speed measures 
and norma appears promising. 

summahy 

In this paper several questions relating to the r61o of mental 
speed in behavior have been raised, and a method of obtaining 
normally distributed measures of speed has been proposed. 
Considerable evidence has been presented in support of the 
hypotheses that (1) times of response to mental test items, 
measured in log seconds, tend to be normally distributed in the 
individual and (2) times of response on a singlo item, measured 
in log seconds, tends to be normally distributed in a group of 
individuals. Two statistical mothcKl.s of controlling accuracy 
have been suggested. The extent of the stability and consistency 
of speed of response to sentence completion items for three 
samples of individuals has been briefly described. 
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GAINS IN SCHOLASTIC APTITUDE UNDER 
HIGHLY MOTIVATED CONDITIONS 

GEOItaE E. SCHLESSER 
Department of Education, Colgate University 

Results of an experimental sixteen-week intensive training 
program for adult servicemen showing change in scholastic 
aptitude seem worth while adding to the increasing amount of 
evidence concerning the constancy and change of scholastic 
intelligence. At present the majority of studies have used data 
on students of school and college age, but have not found adult 
groups as accessible for retesting. The study has bearing on 
two issues in educational psychology. (1) Does scholastic 
intelligence as measured by tests stop growing at age sixteen, 
in the early twenties, or later? (2) How great a change would 
highly motivated schooling make in the scholastic intelligence of 
young adults? 

On tho latter issue, data on mountain, gypsy, and canal boat 
children, who are educationally isolated, have revealed a drop 
of over twenty-five IQ points or about one hundred sixty scaled 
score points* in an eight- or nine-year period. Soldiers of World 
War I from educationally baclcward states had a lower IQ than 
did soldiers from states with advanced educational systems. 
Children adopted into favorable foster homes also show an 
average increase of about five IQ points. These facts have led 
Bingham to conclude that “there can he scarcely any doubt 
today that schooling and other educative experiences tend to 
increase a child’s inteUigence.” Can adults improve their 
scholastic intelligence under favorable conditions even after 
they are twenty years old? 

In this study, scholastic intelligence is measured by the ACE 
Psychological examination and high motivation took place 
during Navy Pre-Midshipmen Refresher Program at Colgate 
University. The purpose of the program was to give enlisted 
men with an average of three years’ college training an oppor¬ 
tunity of completing midshipmen’s training on an equitable 
basis with other officers candidates who had completed college 

* In this paper one hnudved sealed score points ec\v\al 1.00 SD and sixteen 
IQ points equal 1.00 SD. 
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\YOi'k. Such men were recommended as candidates for this V-7 
program by the captains of their ships or by their shore-based 
commanding officers. Every one wanted to become an officer 
and knew that by completing the refresher program and by 
passing his sixteen w'eeka' training in Midshipmen's School ho 
definitely would be made an officer. Here an opportunity for 
up-grading was given in which both the goal and the steps to 
reach it were defined. It was Colgate's task to see that each 
man's aptitudes and achievements were so appraised that he 
could be given training at the proper speed and level. Some 
men would need sixteen weeks of refresher work; some, eight 
weeks; and few would be able to go on immediately. The 
refresher course consisted of English, mathematics, engineering 
drawing and physics and physical training. In an eight or 
sixteen weeks' course, a man had to take a full year’s work in 
physics, mathematics, algebra, trigonometry, and navigation 
and a full year’s work in English and an equivalent of a full year’s 
work in engineering drawing. Physical training and drill were 
added, so that all the w^ing hours of a man's time on week days 
were completely consumed. 

Evidence from two sets of interviews indicates that the drive 
to succeed was very strong. A new group entered each month 
starting in July, 1944, through September, 1945. At the time 
of entrance each man was given the 1941 Edition of the ACE 
Psychological Examination and other tests. Those who were 
to remain in the program sixteen weeks, actually seventy-five 
per cent of the total, were given the 1942 Edition of the Psy¬ 
chological Examination after twelve weeks. These editions 
according to the norms were nearly comparable and were con- 
Btructed as equivalent forms. The norms show that the 1942 
edition actually is four points or seven percentiles more difficult, 
so that actual change is greater than apparent change in raw 
score. 

A description of the nature of the population will be important 
for later interpretation. The men were 24,6 years of age, had 
been out of college about 3.2 years after going to college at least 
two and an average of approximately three years. Fifty-two 
per cent were men \vith overseas duty. Most of the remainder 
had transferred from an Air Cadet (V-6) program. They came 
from all forty-eight states with the largest portion, ten per cent, 
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having attended high school in New York State. Next ranking 
states were California, Illinois, Pennsylvania and Texas, respec¬ 
tively. A sample was slightly below average in scholastic 
intelligence for college freshmen (40th percentile) at the time of 
initial entrance to college six years earlier. [Data on thirty-six 
men for whom comparable earlier tests were available are pre¬ 
sented in the third succeeding paragraph.] 

Tor purposes of this study, five classes from September, 1944, 
to January, 1945, inclusive were selected to determine whether 
any unusual gain in scholastic aptitude was to be found. Table I 
shows that for these two hundred sixty-one men the average 
gain was from the 56th percentile to the 78th percentile, or a 
gain of twenty-two percentiles. Every one of the five groups 
gained more than twenty percentiles. At the time of entrance 
the average score for the groups was 110.7 and at the close of the 
twelve-week period the score was 126.7, This difference is over 
seven times what might be expected from chance (CR = 7.1). 


Table. I.— Pretest and Retest Results on the ACE Psy¬ 
chological Examination in a Twelve-week Period 




Pretest 

Retest 

Raw Score 

Pretest 

Retest 

Group 

N 

Average 

Average 

Gain 

SD 

SD 

Total 

261 

110.66 

126.70 

16.04 

22.98 

22.08 

A 

40 

104.90 

122.60 

17.70 

21.18 

21.00 

B 

64 

112.40 

127.04 

14.64 

19.08 

19.66 

C 

53 

110.84 

126.54 

14.70 

23.28 

23.88 

D 

61 

109.04 

122.64 

13.60 

20.94 

18.96 

E 

63 

114.08 

129.20 

16.12 

24.62 

23.82 


At the same time the men remained in relatively the same 
position with respect to each other. This is indicated by a cor¬ 
relation of .88 between the pretest scores and the retest scores 
of the two hundred sixty-one men—a coefficient which is almost 
as high as the reliability of the test, even though it includes a 
twelve-week lapse of time. 

It was thought possible that the gain might be due to loss of 
scholastic aptitude during their several years of service with the 
fleet and that this increase represented a return to their normal 
score. To test this, letters were sent to their earlier colleges for 
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the classes entering in September; 1944; and November; 1944, to 
obtain scholastic aptitude scores given at the time of entrance to 
college. Thirty-six of these returns were such that I'esults 
could be directly compared to the later pretest results. The 
raw score mean for the thirty-six men at tho time of college 
entrance was 94.9, their mean at tho time of pretest was 108.4, 
and their mean at the time of retest was 122,2. Thus, over a 
period of about six years they had gained thirteen and one-lialf 
raw score points or sixty scaled score points. Whether this is 
lower than normal growth cannot be answered, but there is 
some evidence to show that greater menial growth should be 
expected during the four college years.^ The sample appears 
to be about two or three points lower in scholastic intelligence 
than the large group. 

There are several possible factors that may account for some 
of the gain of the large group; (1) practice effect, (2) regression if 
below average individuals are used, (3) normal growth during tho 
twelve weeks, (4) gonuino giwvth in menial alertness during tho 
refresher program. The practice effect of retaking CEEB 
scholastic verbal aptitude test is a gain of about twenty scaled 
score points, even though different forms are ii.sed.^ It seems 
reasonable to assume, then, that the effect of such practice on the 
ACE Psychological Examination accounts for not more than 
about twenty of the sixty-eight scaled score points gained by the 
V-7 men. 

The amount of change due to regression, the second factor, 
should be negligible, for the sample indicated that the large 
group averaged between the 40th and 45th percentile according 
to national norms at the time they entered college. Likewise 
the change due to normal growth, factor three, during the three- 
month period should be very small. One study showed the 
growth to be about ten scaled points for three months for seven¬ 
teen and eighteen year olds.® Normal gi’mvth at the average 
age of twenty-five is probably less than this. If ten scaled 
points are assigned to the influences of both the second and third 
factors a genuine growth of thirty-eight scaled score points or a 

1T. M. Livesay, "Does Test Intdligenco Increaso at the College Lovol," 
Joumol of Edjicaiional Psychdogj/, Volume 30, 1639, pp. 63-08. 

* Richardson, Pearson, "Effoote of Growth and Retesting on SAT Verbal 
Scores,” The College Board Reoiem, Vol. I, No. 6, Fall, 1048, pp. 67-71. 
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gain of eleven percentiles may be attributed to the special 
educational experience. 

The question of shift in rank in scholastic aptitude also has 
significance for guidance. In the sample group of this study 
the correlation between earlier entering college scores and 
pretest score was .GO. (The correlation between, pretest and 
retest has already been reported to be .88). Another study has 
shown the correlation during a nine-year adolescent period to 
be about .50.® These two cormlation coefficients are in relative 
agreement. If substantiated by other studies, they suggest 
that there may be considerable shifting in the relative rank of 
young adults in scholastic aptitude. Test scores of entering 
freshmen may be only moderately predictive of senior or adult 
scholastic intelligence. 

CONCLUSIONS 

1) An average gain of twenty-two percentiles (sixty-eight 
scaled score points) in scholastic aptitude over a twelve-week 
period was consistently shown by five classes in which the 
average age was 24.6 years. 

2) About half of this gain might be accounted for by practice 
effect, regression and maturation, but a significant average 
gain of at least eleven percentiles or thirty-eight scaled score 
points still remained which may be attributed to the effects of the 
training program. 

IMPLICATIONS 

1) Counselors of freshmen can encourage freshmen who rank 
below average in scholastic intelligence. Under the right 
motivation and working conditions whole groups can increase 
their tested scholastic intelligence by twenty-two percentiles. 
Many individuals can do better; some may do worse. 

2) The entering freshman’s scholastic intelligence percentile 
seems to remain very stable in a relative sense over a three 
month’s period, but it may fluctuate over a period of years 
sufficiently to make the retesting desirable for graduate schools 
or for industries that use scholastic intelligence as one of several 
selection devices. 

* H. E, Jones, and H. S. Conrad, “Mental Dovolopment in Adolescence,” 
J^rd Yearhook, The National Society for the Study of Education, Part I, 
p. 169. 
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COMMBNTS 

Interpretation in this study is admittedly conservative. The 
practice effect on the ACE Psychological Examination may be 
loss than the twenty scaled points of the SAT Voi’bal Examina¬ 
tion, because of the practice exercises in the former. Also if 
the four raw score or eighteen scale score points due to the 
greater difficulty of the 1942 edition were added to tho apparent 
gain, the change during the twelve-week intensive educational 
program would be even more impressive. 



INTERGEOXJP ATTITUDES OE GENTILE, JEWISH, 
AND APACHE INDIAN CHrLDREN 


ROSE ZELIGS 

Avondale Public School, Cincinnati 

The purpose of this study is to present the intergroup attitudes 
of Gentile, Jewish, Apache Indian, Seventh Day Adventist, delin¬ 
quent, rural, and city children, as expressed on the Zeliga Inter¬ 
group Attitudes Test. 


THE SUBJECTS 

The subjects of this study were one hundred sixty-three 
Jewish, thirty Protestant, and seven Negro twelve-year-old 
children studied in 1931; who attended the AV suburban public 
school in Cincinnati, Ohio; one hundred fifty Jewish, thirty-thveo 
Protestant, and nine Negro twelve-year-old children who 
attended the same school in 1936; one hundred fifty Jewish, 
twenty Protestant, and four Negro twelve-year-old children who 
attended the same school in 1944; forty-two Protestant twelve- 
year-old children studied in 1936 who attended the PR public 
suburban school in Cincinnati, Ohio; one hundred thirty-seven 
Apache Indian children ranging from thirteen to seventeen years 
in age, from Whiteriver, Arizona, studied in 1934; fifty-nine 
Cincinnati high-school students; forty-six rural northern Ohio 
high-Bchool students; twenty-three delinquent girls; and eleven 
Seventh Day Adventist children, studied in 1944. 

TECHNIQUES AND PKOCEDUEES 

The children were given the Zeligs Intergroup Attitudes Test 
which requires the subjects to indicate their willingness to accept 
members of each of thirty-nine races and nationalities for the 
relationships of cousin, chum, roommate, playmate, neighbor, 
classmate, and schoolmate, by writing ‘yes’ for the relationship 
and to express their unwillingness by writing ‘ no ’ f or the relation¬ 
ship indicated. The index of friendliness was computed by add¬ 
ing the ‘ yes’s ’ expressed by all the subjects towards each race and 
nationality and computing its percentage of the total possible 
number of 'yes’s.’ The total number of 'yes’s’ on the entire test 
was used as the child’s score in intergroup friendliness. 
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THE FINDINGS 

In 1931 the Gentile children of the AV. School scored somewhat 
higher on the Intergroup Attitudes Test than the Jewish children, 
having an average score of 124 as against 117. In 1935 the 
Jewish children scored 126 as against 107 for the Gentile children 
of the AV. School and 134 for the Gentile children of the PR. 
school. The average of 121 for all the Gentile children studied in 
1935 indicates little difference between the Gentile and Jewish 
children in tolerance. The average score for the boys these 
various times was always somewhat higher than for the girls. 
The Apache American Indian children of Whiteriver, Arizona, 
studied in 1934, whose average was 96, scored significantly lower 
than the twelve-year^old Cincinnati children. 

The social distance the children cxjjressed for the different 
relationships shows that 'cousin* and 'roommate* are considered 
the most intimate relationships by all the groups studied. In 
1931 the Jewish children were more particular than the Gentilo 
children for those relationships, but in 1936 the Gentiles wore 
more particular. In 1936 the difference between 'cousin' and 
‘chum’ was the same for both groups of the AV. School. The 
PR. School children were slightly more particular about ‘room¬ 
mate’ than ‘cousin.’ The difference between ‘cousin’ and 
‘chum’ was less for these children than for those of the AV. 
School. The Jewish children tend to make more definite dif¬ 
ferentiation than the Gentilo children between the moat distant 
and least distant relationship. The Indian children expressed 
less difference than the white children between these relationships. 

Table 1 gives the degree of friendliness toward thirty-nine 
races and nationalities expressed by the twelve-year-old children 
in 1931 and 1936, and by the Indian childi'en in 1934. All groups 
except the Indian children ranked American first. The Indian 
children ranked American second. In 1931 the Jewish children 
ranked German Jew second. American, English, Dutch, Irish, 
American Indian, Canadian, French, and German, were ranked 
high by most of the groups, while Finn, Roumanian, Hindu, 
Bulgarian, Mulatto, Bohemian, Syrian, Negi'o, Servian, and 
Armenian were ranked low. The Jewish children tested in 1931 
showed slightly less favor than those tested in 1936 towards 
American Indian, French-Canadian, Italian, Mexican, Czecho¬ 
slovakian, and Finn. The 1936 Jewish subjects showed greater 
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Table L—Index of Friendliness toward Races and Nation¬ 
alities Expressed by Twelve-year-old Jewish and 
Gentile Children and by Apache American 
Indian Children. [Expressed in 
Percentage.] 



1931 

1936 

1036 

PR. 

School 

Gentile 

1936 
AV. & 
PR. 
School 
Gentile 

1934 

Apache 

Indian 

AV. School 

Jew 

Gen¬ 

tile 

Jew 

Gen¬ 

tile 

American 

96 

99 

97 

100 

100 

100 

86 

English 

81 

89 

84 

84 

08 

90 

, 66 

Irish 

63 

70 

53 

61 

77 

70 

48 

Dutch 

68 

72 

64 

67 

76 

C8 

65 

American Indian 

60 

1 

1 

60 

74 

; 67 

SO 

Canadian 

69 

' 64 

' 61 

40 

73 

58 

29 

French 

72 

86 • 

71 

60 

71 

66 

42 

Scotch 

45 

68 

49 

43 

70 

68 

38 

French-Canadiaii 

44 

60 

62 

36 

66 

62 

38 

Swedish 

61 

60 

50 

43 

65 

65 

30 

German 

63 

77 

36 

61 

63 

67 

36 

Italian 

41 

47 

60 

48 

62 

66 

41 

Dane 

36 

37 

40 

40 

60 1 

49 

17 

Japanese 

61 

62 

48 

36 

60 

49 

46 

Norwegian 

49 1 

66 

48 

42 

59 1 

61 

22 

Polish 

54 

34 

64 

83 

68 

47 

26 

Mexican 

42 

61 

50 

34 

67 

47 

52 

Spanish 

48 

66 

62 

49 

66 

52 

46 

Filipino 

35 

62 1 

42 

23 

63 

40 

83 

German Jew 

85 

61 

77 

39 

46 

43 

80 

Russian 

68 

41 

59 

37 

46 

42 

88 

Greek 

44 

48 

47 

46 

45 

46 

32 

Turk 

33 

36 

39 

28 

44 

37 

37 

Chinese 

86 

39 

42 

32 

44 

30 

35 

Portuguese 

29 

28 

39 

18 

44 

32 

27 

Arab 

24 

32 

30 

26 

44 

85 

24 

Hun garian 

37 

40 

40 

31 

41 

37 

26 

Czechoslovakian 

30 

36 

42 

29 

41 

37 

28 

Russian Jew 

80 

60 

77 

37 

39 

38 

27 

Finn 

17 

34 

35 

19 

37 

29 

28 

Roumanian 

36 

24 

40 

21 

34 

28 

18 

Hindu 

22 

21 

26 

16 

32 

25 

17 

Bulgarian 

31 

29 

37 

30 

31 

30 

26 

Mulatto 

10 

9 

10 

B 

26 

16 

24 

Bohemian 

13 

16 

20 

12 

20 

16 

18 

Syrian 

12 

8 

19 

14 

20 

17 

18 

Negro 

18 

20 

21 

13 

16 

14 

28 

Servian 

11 

11 

17 

12 

12 

12 

18 

Armenian 

11 

10 

11 

11 

11 

12 

26 
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antipathy towards the Germans, assigning them twenty-ninth 
place as against the eighth place given by the group tested earlier. 
The Gentile children of the AV. groups, tested in 1931, showed 
greater favor than the 1935 group towards the Canadians, 
Germans, Japanese, Mexicans, Filipino, and Gorman Jew, and 
less favor towards the Spanish. 

A comparison of the 1935 Gentiles of the AV. School with those 
of the PR. School indicates more favorable attitudes by the AV. 
subjects towards the French, Germans, and Italians, and greater 
antipathy towards the Scotch, Canadians, French-Canadians, 
Japanese, Polish, Mexican, Filipino, and Portuguese. The Gen¬ 
tile children of the AV. School, who came in. contact with many 
Jewish children, show more favor towards German and Russian 
Jews than the Gentile children of the PR. School where no 
Jewish children were enrolled. 

Comparing the Jewish with the Gentile children of both 
schools, the Jewish children show much more favor towards 
German Jews and Russian Jews, Russian, and Polish, while the 
Gentiles favor the Irish, Scotch, German, and American Indian. 
In General, these reactions are in keeping with the ethnic back¬ 
ground of the children. 

Comparing the Indian with the Gentile children, differences 
represent more favorable attitudes of the Indian children 
towards the Japanese, Mexicans, Spanish, German Jew, Turk, 
Chinese, and Negro, and less favorable attitudes towards the 
French-Canadian, Swedish, German, Bone, Norwegian, and 
Polish. Many of these differences may be explained by the 
ethnic backgrounds and contacts of the children. There was 
close agreement between the two groups in their attitudes 
toward the other twenty-six races and nationalities on the test. 

There seems to be a general pattern among all the groups. 
This pattern tends to favor the North European peoples with 
special ranking for the English, Irish, Dutch, Canadian, French, 
Scotch, French-Canadian, Swedish, Gorman, and Italian. This 
cultural pattern of group prejudice is similar to that of college 
students studied by Thurston^and of adults studied by Bogarclus. '■ 

In 1944 the test was given to city high-school students, rural 
high-school students, delinquent girls, and Seventh Day Advent¬ 
ist adolescent children. The city high-school students, with an 
average score of 169, were the highest. Then came the sixth- 
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grade children with an average of 160, the Seventh Day Advent¬ 
ists with an average score of 161, and the rural high-school 
students with an average of 144. The delinquent girls with an 
average score of 117 were much lower than the othei' four groups. 
It is possible that this low score is due to lack of knowledge about 
some of the races and nationalities rather than to unfavorable 
attitudes. These girls were low in intelligence, their intelligence 
quotients being between 80 and 90. 

The social distance expressed for the different relationships 
showed that all five groups ranlted cousin first, roommate second, 
and chum third. The sixth-grade and the city high-school stu¬ 
dents were more particular about neighbor than were the rural 
high-school students, the Seventh Day Adventists, and the 
delinquent girls. The difference between the most intimate and 
least intimate relationship was forty per cent for the sixth grade; 
thirty-eight per cent for the city high-school students; thirty-five 
per cent for the rural high-sohool students; forty-six per cent for 
the Seventh Day Adventists, and fifteen per cent for the delin¬ 
quent girls. 

The ranking of the' thirty-nine races and nationalities were 
noted. All five groups ranked American first. The races and 
nationalities towards which the highest degree of friendliness were 
expressed in 1944 were American, English, Canadian, Hawaiian, 
South American, Irish, French, Australian, American Indian, and 
Dutch. At the bottom of the list, showing the least friendliness 
expressed towards them, were German, Dane, Bulgarian, Negro, 
Roumanian, Portuguese, Arab, Finn, Japanese, Hindu, Albanian, 
and Mulatto. 

There was close agreement among all five groups in their atti¬ 
tudes toward American, English, Dutch, Norwegian, Roumanian, 
and Albanian. Four of the five groups showed close agreement 
in their attitudes toward Canadian, South American, Plawaiian, 
Chinese, Irish, Australian, Swiss, Spanish, Greek, Polish, French- 
Canadian, Italian, Czechoslovaldan., Hungarian, Bulgarian, 
Negro, Portuguese, Arab, Finn, Japanese, Hindu, and Mulatto. 

The Seventh Day Adventists were more favorable toward the 
Jews than were the high-school students or the delinquent girls. 
Some of the differences may be explained by the racial and 
national background of the subjects. Except that the present 
subjects rank German and Japanese much lower, and Russian 
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and Chinese higher than in earlier studies,^ the general pattern of 
the fi've groups is similar to the attitudes of children studied 
before 1944. The large number, of Jewish children in the sixth 
grade of the AV. School and of Negro children among the delin¬ 
quent girls studied explains the high ranks given the Jew and 
Negro by those subjects. In most other cases there is much 
agreement among the five groups in their attitudes. 

SUMMARY 

The trend in children’s attitudes is definitely toward better 
understanding. With the exception that children show more 
favor towards their own racial, religious, or national group, the 
general pattern of likes and dislike expressed by the Jewish, 
Gentile, and Indian children is very similar. Gentile children 
who came in contact with Jenish children showed more favor 
towards Jews than those who had few contacts with them. The 
war undoubtedly made children more conseioua of their attitudes. 
Where formerly the tendency was to favor those who were like 
them in color and culture, such as the North Europeans, tho 
trend changed towards favoring allies, regardless of other factors. 
Although the children do feel closer to people who are similar to 
Americans in color, culture, and language, the trend is towards a 
wider outlook. The Germans were disliked while the Chinese 
and Filipinos were admired as friends and allies. There was little 
difference in the scores of the sixth-grade and high-school stu¬ 
dents. The rural children scored somewhat lower than the city 
children. The children studied in 1944 were less afraid of dif¬ 
ferences in race or culture than the children studied earlier. 

RSFIIBRNGDS 
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2) L. Ii. Thuvstone, “An Experimental Study of Nationality 
Preferences.'’ Journal of General Psychology, 1928, 1, 406^426. 

3} Bose Zeligs, “Children's intergroup attitudes.” The Jour- 
nal of Genetic Psychology, 1948, 72,101-110. 
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Pa-LMEr O. Johnson. Statistical Methods in Research. New 
York: Prentice-Hall, Inc., 1949, pp. 377. 

With the increasing use of statistical techniques in research, 
greater emphasis must necessarily be placed on the interpretative 
function of statistics. The statistician needs to know more than 
how to collect and describe large masses of data. In recognition 
of this need, Dr. Johnson has prepared a book which stresses 
understanding of the theoretical bases and the underlying assump¬ 
tions of methods used by the research worker. His stated aim 
is to supply students with a book built on the recent advances 
in theory and practice pertaining to the problems of testing 
statistical hypotheses and of statistical estimation. 

Those who are particularly interested in psychology and in 
education will be pleased to note in the preface that ‘Hhe book 
, . . was developed . . . primarily for graduate students in 
education and in psychology.” It is also reassuring to find on 
page 14 the statement that the book “is written for readers 
without specialized mathematical training.” But despite these 
statements and the fact that Statistical Methods in Research is a 
scholarly work which includes a considerable number of illustra¬ 
tive applications of principles, it is generally not suitable as a 
text for graduate students in psychology and education. 

The book begins with a discussion of probability and likelihood. 
This is followed by sampling distributions and the building up 
of statistical models against which experimental results may be 
checked, e.g., the normal distribution, t, and chi-square. A 
short and heavy discussion of the general theory of testing 
statistical hypotheses leads into a long chapter devoted to 
current procedures. Illustrative problems demonstrate the 
use of various tests of significance. Chapter VI is entitled 
“The Estimation of Population Parameters.” This includes a 
concentrated theoretical treatment of estimation (point estima¬ 
tion and estimation by inteiwal, fiducial limits and confidence 
intervals) and the solution of a number of problems of interval 
estimation. This is followed by a discussion of normal and 
normalized distributions in which Pearson’s and Fi.sher’s methods 
for testing the normality of a sample are demonstrated, The 
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succeeding chapter, given ov«r to the statistical analysis of data 
under non-normal assumptions, should be of particular interest 
to those coneei'ned with data which consist of I’anldngs. Chapter 
IX is a vei’y good discussion of the various kinds of sampling 
systems and the types of errors that may be encountered in 
investigation by sample. Chapters X and XI deal with analysis 
of variance and covarianco and the application of these tech¬ 
niques in practical problems. Chapter XII, on the principles of 
experimentation, is a clear discussion of the self-contained 
experiment and of the r6ie of statistics in the design of experi¬ 
ments. Chapter XIII illustrates the application of principles 
of experimentation in various kinds of design, and the last 
chapter carries through the complete analysis of a regression 
problem and a problem in the use of discriminant function. 

Although the major topics are presented in logical order, 
some questions may be raised about the placement and emphasis 
of sub-topics. Yates’ correction for continuity in connection 
with chi-squaro is noted very briefly and the reader is referred 
to a reference. Since this correction is frequently called for in 
psychological experiments, it is unfortunate that more space is not 
devoted to it. On the other hand, three tests of homogeneity of 
variability are described and illustrated when one method would 
seem sufficient. Degrees of freedom aiu mentioned a number of 
times in the first five chapters but the concept is not explained 
until the close of Chapter VI. The analysis of covarianco is 
briefly defined and the problem illustrating its application is 
much too complex to clarify the use of the method. But these 
criticisms are relatively minor when compared with the general 
comment that the book is extremely difficult reading. Psy¬ 
chology and education students who have had no more than one 
year or one course in descriptive statistics will generally find 
that they are beyond their depth throughout large portions of 
the text. Calculus is rather infrequently used but there is great 
stress on the mathematical formulation and development of 
statistical concepts. The style in many places is similar to that 
of highly technical journals. In a book of reasonable size, this 
style is perhaps unavoidable when the presentation has been 
based on original and secondary sources of mathematical sta¬ 
tistics. But it limits the use of the book to those readers who 
have a solid foundation in mathematics or to those who have 
had considerable prior statistical training. 
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It is the reviewer’s opinion that Statistical Methods in Research 
will be found most useful as a reference text or as a course text 
for those with a major interest in statistics. For most graduate 
students of psychology and education the book would bo of very 
limited value. Jerome E. Doppelt 

The Psychological Corporation 

Paul F. Lazaesfeld, and Frank N. Stanton, Editors. Com¬ 
munications Research 1948-1949. New York: Harper and 
Brothers, 1949. pp. 332. 

The field of communications I'esearch differs in emphasis from 
educational research in being concerned more with the impact of 
mass media, such as newspapers and radio, on persons of all 
ages, especially adults, usually in out-of-school situations. 
These differences in substance are not intellectually significant, 
however, and readers of the Journal will find much in this 
volume that is interesting and provocative. 

The eight studies here collected fall into three methodological 
categories. The first, intensive interview studies, consists of 
(1) "The Children Talk about Comics” by Katherine M. Wolf 
and Marjorie Fisk; (2) “Research For Action” (a study of radio's 
morning audience) by Paul F. Lazarsfeld and Helen Dinerman; 
(3) “What ‘Missing the Newspaper’ Means” by Bernard 
Berelson; (4) "The Analysis of Deviant Cases in Communica¬ 
tions Research” by PatriciaL. Kendall and Katherine M. Wolf; 
and (6) " Patterns of Influence: A Study of Interpersonal Influence 
and of Communications Behavior in a Local Community” by 
Robert K. Merton. What these studies have in common, is a 
highly insightful, well-nigh clinical, analysis of responses obtained 
by skilled interviewers from samples of persons chosen because 
of their special importance to the problem under attack. These 
studies are rich in verstehen; the designs, analyses and inter¬ 
pretations reflect intimate acquaintance with the research area, 
immersion in the data, and creative imagination in synthesizing 
hypotheses and conclusions. 

For lack of space, we shall exemplify this group of researches 
only with the study of comics. We are given classifications 
(1) of comics into ‘funny animal,’ 'adventure' and ‘educational’ 
types, (2) of comic reading into three chronological stago.s, 
(3) of functions of comics into the Alice in Wonderland, or 
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variety aud action function, the ‘batman’ function (the invinci¬ 
bility of the vincible)] and the Reader's Digest function, (4) of 
readers into fans, moderates, and indiffemnts or hoatiles. Each 
of these ciassificatory schemes is exhibited in relation to varioua 
others. Psychological ideas are used freely, among these 
being ‘ego-atrengthening,’ ‘projection,’ ‘identification,’ and 
‘adjustment.’ 

The recurrence of trichotomies makes us wonder, of course, 
^vhGther they are intrinsic to the data or merely a Procrustean 
methodological rut. But the qualitative descriptions of these 
conceptual schemes and the anecdotal quotations illustrating 
them do succeed in bringing the discussion to life in a manner 
seldom seen in research reporting. We hope it was not a neces¬ 
sary concomitant of this liveliness that few of the tables showing 
relationships are summarized in coefRcients of any kind, and 
no tests of statistical significance are reported. So important 
a conclusion as the following is buttressed by a single sentence 
devoid of either a coefficient or a level of confidence; “Cross 
classification of children by degree of psychological adjustment 
and degree of interest in comic reading reveals that only one fan 
is psychotic and a bare handful of fans are normal children. 
But a marked correlation is revealed between neuroticism and 
being a fan. Of all the neurotic childmn, fifty per cent are fans 
and only thirty-three per cent moderate readers, while for 
problem children the proportion is exactly reversed, fifty-four 
per cent being moderate readers and only thirty-two per cent 
fans.” (p. 29) 

Somehow we missed these traditional impedimenta of educa¬ 
tional research. Perhaps they ere absent for the sake of road¬ 
ability. This cavalier approach to statistical description and 
inference prevails throughout the book. This is hard to under¬ 
stand since other evidences of research integrity and skill are so 
abundant. Furthermore, in several other places, these papers 
show much less concern for journalistic vigor. We wish an 
explanation had been made of this disregard for what so many 
graduate students have had to learn about statistical methods in 
research. 

The second category of papers, statistical reports, consists of 
(1) “An Analysis of Radio’s Programming” by Kenneth Baker; 
and (2) "Overlapping Magazine Reading: A New Method of 
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Determining the Cultural Levels of Magazines" by Babclto 
Kofls. The former is a straightforward sampling survey of 
facts about the programs broadcast by commercial atatious 
during a typical week in 194C. Apart from the facts them¬ 
selves, this study is noteworthy primarily for tlie Iharouglmoas 
and sophistication evident in the description of procedure. 

The study of magazine reading ia devoted to tho dovclopmeiil 
of a coefTiciont, called ^phi,* of overlapping reading. Tlii equals 
c/Vab where a is the number reading Magazine A, b is the 
number reading Magazine B, c is tho number reading both A 
and B, Its correlation with impresBioniatio judgment rankings 
of magazines is high, the deviations from perfect correlation 
are analyzed, and limitations of the method are described. 
Since this phi coefficient correlates so highly with tho more 
easily obtained ratings of magazines by judges, it will probably 
not be used in practice. Rather than validating phi against 
impressionistic judgments, wo would set up plii as the criterion. 

The last study is “Domestic Broadcasting in the U.S.S.R." 
by Alex Inkeles. Based largely on material in Soviet radio 
'trade' journals, this more sociological and politico-economic 
kind of communications research can furnish perspective for 
educational and social psychologiste interested in comparing 
relationships between social systems and cultural forces. 

All in all, the volume combines extraordinary virtues with 
defects we might never have noticed had not tho general level 
been so high. Hence, for a change, we find ourselves fooling 
needs for less facile hypothesizing, for greater integration of 
typologies and constructs from one study to the next, and for 
more statistical timidity in drawing conclusions. It is also fair 
to say that these communications researchors would find much 
to emulate in the superior attention to previous work and the 
more adequate presentation of statistical evidence that charac¬ 
terize most research in educational psychology. But as models 
of researcli approaches that can fruitfully bo tiansferTed to 
educational problems more traditionally conceived, iheso studies 
deserve careful reading by students of educational psyciiolngy. 

N. L. Gagw 


University of Illinois 
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AN EXPERIMENTAL PROJECTIVE TECHNIQUE 
FOR THE ANALYSIS OP RACIAL ATTITUDES* 

GRANVILLE B. JOHNSON, JR. 

Arizona State Collego at Flagstaff 

The important r61e which attitudes play in the social develop¬ 
ment and integration of individuals and societies has precluded 
much significant research concerning it. The techniques of 
measurement and evaluation utilized in research on attitudes 
are as varied as the many problems intrinsic to the study. 

A review of the recent literature on attitudes reveals that a 
large majority of investigations concerning attitudes uses the 
objective technique in which attitude scales are devised, applied 
to a specific group, and the results treated statistically. Each 
attitude is considered a specific characteristic of the subject 
and it acquires significance through comparison \Yith other 
members of the selected population. There is most often no 
attempt to relate the revealed 'attitude* to the total individual. 
“The resulting conclusions from such a psychologically molecular 
analysis of attitudes have usually been that people have different 
attitudes on different subjects, that these attitudes are often 
internally inconsistent and irrational, that people acquire atti¬ 
tudes and stereotypes as a result of suggestion, propaganda, 
conditioning and fortuitous experiences which are imposed upon 
them by outside forces."* 

Opposed to the molecular analysis of attitudes is the technique 
utilizing the molar approach. This method of investigation 
considers an attitude as a manifestation of a total reaction, a 

* This article is the first of a series of three concerned with the origin and 
development of racial attitude. The second study, entitled “The Origin 
and Development of the Spanish Attitude Toward the Anglo and the Anglo 
Attitude Toward the Spanish," and the third, "The Relationship Existing 
Between Bilingualism and Racial Attitude," will appear in later issues of 
Tub Journal. 
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part which contributes to the whole and which is determined 
by the whole. In the study of racial antagonism, for example, 
it is not sufficient to classify the selected population into pro 
and con categories. The total personality must be considered 
as completely as clinical tools will permit in order to determine 
the bases for the prejudice. 

THE PROBLEM 

The purpose of the present study was to devise an instrument 
which could be used in the investigation of racial attitude bases 
and development by analyzing personality as a whole, thus mak¬ 
ing it possible to investigate the dynamics of behavior, 

\rATBBlALa AND SUBJECTS 

Materials, —(1) The Projective Tost of Racial Attitudes com¬ 
posed of six carefully selected pictures relevant to race situations 
and provocative of projected response was used for tho analysis 
of racial attitudes. There was a hero figure with whom the 
subject identified himself and thus projected something of the 
dynamics of hia personality into tho depicted situations. 

The situations conducive to projected response were identical 
except for the ethnic group variable. For Anglo subjects there 
wore six cards of totai Anglo content and six with an Anglo 
hero in. a Spanish situation. For Spanish objects the situations 
were reversed with a Spanish hero in an Anglo situation in six 
cards with identical cards without the Anglo element. 

(2) A tabulation, sheet was used for recording the dynamics of 
responses. 

Subjecis.—(1) Anglo: thirty male subjects (four-, eight- and 
twelve-year levels, N = 90) from a Southwestern public school 
system. 

(2) Spanish: thirty bilingual male subjects (four-, eight- and 
twelve-year levels, N = 90) from the same Southwestern town. 

A further limitation was that members of both groups wore 
required to have lived in this town for the year prior to testing. 

THE PROJECTIVE TEST FOB TUB STUDY OP RACIAL ATTITUDES 

The present investigator through empirical analysis decided 
that the most successful method of investigating attitude bases 
and development was by use of the projective technique which 
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makes it possible to analyze personality on a molar level. This 
technique distinguishes between opinion and attitude and makes 
it possible to investigate the dynamics of behavior; these are 
two factors not found adequately in the traditional objective 
techniques. 

The Selected Pictures of the Projective Test of Racial Attitudes .— 
When the Projective Test of PAcial Attitudes was originally 
conceived, eighteen pictures were experimentally tested. It was 



found that the six in the present series were adequate in that they 
covered generally most social situations an individual of the 
selected ages would ordinarily meet; they fell within the attention 
span of even the four-year-olds, were of intrinsic interest at 
each of the sclect’ed age levels, and contained life situations with 
portrayed behavior most easily empathized by the subjects. 

The cards are in color and consequently cannot be reproduced 
here. However, one is reproduced in black and white to show 
the character of the pictures. (See Fig L) They were pre¬ 
sented in the following experimentally derived sequence: 
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For Spanish Subjects— 

1) Spanish and Anglo cowboys approaching each other. 

2) Spanish boy running down the street. 

3) Spanish boy and Anglo boy holding a bat. 

4) Two Spanish boys standing with broken, toy between 
them. 

5) Anglo girl crying with Spanish boy observing. 

6 ) Spanish girl possibly inviting Spanish boy to share soda. 

7) Two Spanish cowboys approaching each other. 

8) Anglo boy running down the street. 

9) Two Spanish boys holding bat. 

10) Spanish boy standing with Anglo boy with broken toy 
between them, 

11) Spanish girl crying with Spanish boy observing. 

12) Anglo girl possibly inviting Spanish boy to share soda. 
For Anglo Subjects— 

1) Anglo and Spanish cowboys approaching each other. 

2) Anglo boy running down the street. 

3) Anglo boy and Spanish boy holding a bat. 

4) Two Anglo boys with broken toy between them. 

6) Spanish girl crying with Anglo boy observing. 

6) Anglo girl possibly inviting Anglo boy to share soda. 

7) Two Anglo cowboys approaching each other. 

8) Spanish boy running down the street. 

9) Two Anglo boys holding a bat. 

10) Anglo boy standing with Spanish boy with broken toy 
between them. 

11) Anglo girl crying with Anglo boy observing. 

12) Spanish girl possibly inviting Anglo boy to share soda. 

Administraiion .— 

A) Physical conditions: The physical conditions of the test 
situation were necessarily controlled. Good lighting was essen¬ 
tial because identification by the subject of the characters in the 
pictures was o£ utmost importaneo. It was important, too, to 
have sufficient table space with no inhibitory stimuli in evidence. 

Rapport between the subject and the administrator was neces¬ 
sarily established before testing could proceed. Friendliness 
and assurance were important in the administrator. 
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B) Instructions: After rapport had been established, the fol¬ 
lowing information was secured from the subject: (1) age, (2) 
name, (3) residence in the town (minimum of one year). At 
this point nothing was mentioned concerning Spanish and Anglo 
relations. 

The directions for administration are as follows: “I am going 
to show you two pictures (present the Spanish and Anglo stereo¬ 
types for mental set) and I want you to tell me which of the two 
boys you like better—which would you rather be?” Then, 
“Which do you look like?” After the choice had been made, the 
following directions weie given: “This is not a test. I am just 
going to show you some pictures and you are going to make up a 
story about each one—an exciting story—as exciting as you can. 
There are no right or wrong answers. You have all the time you 
want. All you are going to do is to make up an exciting story 
about the pictures I am going to show you.” 

After the administrator had answered any questions, the first 
picture was presented. 

C) Procedure:!) Time, (a) The reaction time was recorded, 
(b) The total time was recorded. 

2) Recording. In the upper section of the answer sheet per¬ 
tinent information was recorded regarding age, name, length of 
residence in the town with space for further information. The 
answer sheet was divided into two columns. The responses to the 
first six pictures were recorded in essence, and verbatim, if par¬ 
ticularly significant, in the left column, and the second six in the 
right column. In this manner, the Spanish-Spanish (or Anglo- 
Anglo) pictures were directly aoro^ from their Spanish-Anglo 
counterparts. Roman numerals signified the pictures. The 
reaction time was recorded dii‘ectly behind the numeral and the 
total time immediately after the story. 

3) Questioning. When necessary inquiry was made concern¬ 
ing the incidents which lead up to the situation depicted, what 
was happening at the present time, and what would ultimately 
happen. Questioning was subtle and not leading. It was neces¬ 
sary to repeat that an exciting story was desirable. 

After stories had been told for each of the twelve pictures, the 
subject was asked in direct questioning, how he got along with 
the members of the other ethnic group; in which were most of 
his friends; and what he thought of the other ethnic group in 



262 The Journal of Edvcaiional Psychology 

general. From these data, a correlation between opinion and 
attitude was made. 

4) Length of session. The time required to administer the 
test generally ranged from thirty to sixty minutes depending on 
the intelligence, imagination, and stability of the subject. 

Principles of Inlcrpreiaiion. —The stories wore first read as a 
whole so as to determine roughly the general trends in the themes. 
The method of scoring employed an objective type chart.^ 

I. Effect of the environment on the organism. 

A) Frustrating: rejection, withdrawal. 

B) Neutral. 

G) Helpful: acceptance, friendliness. 

II. Reaction of the organism to the environment. 

A) Frustration: insufficiency. 

1. Aggression. 

2. Submission. 

B) Self-sufficiency: emotional stability. 

1. Attainment. 

2. No conflict. 

III. Adequacy of the principal character. 

A) Superordination of hero. 

B) Equality. 

0) Subordination of hero. 

TV. Ending (hero). 

A) Defeat. 

B) Indeterminate. 

G) Victory, success. 

V. Ending (theme). 

A) Unsatisfactory to society. 

B) Indeterminate. 

C) Satisfactory to society. 

After the test was administered, it was scored with respect to 
the four categories, and the chart for scoring, Table I, was marked. 
Since each picture was identical with its prime number picture 
except for the race variable, any difference between the ' Spnnish- 
Spanish' and ‘Spanish-Anglo' columns were attributed to the 
single variable (order of administration was controlled). This 
was done by finding the standard error of the per cent for the 
total for each year and then finding tlie critical ratio. The size 



Table I.—TABtrLA-TiON Sheet 
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of the difference was assumed to be determined by and reflective 
of the strength of the stimulus to the particular subject. The 
strength of the stimulus varied from subject to subject since 
each experience was affect-provoking to the degree that it 
reflected the individual’s total adjustment pattern. 

The findings of the Projective Teat of Racial Attitudes were 
then compared with the degree of bilingualism; that is, differences 
for each of the five categoidcs were compared with the extent of 
bilingualism. 

Scoring the Projective Test of Racial Atiitudes .—It is important 
in the interpretation of protocols derived from projective tech¬ 
niques to ascertain whether or not the subject is identifying 
himself with one of the characters in his stories since he sometimes 
does not. In some cases, he manifests an attitude or theory 
regarding the outside world. 

Five principles may be used in determining when the subject is 
identifying, and with which character in his story. 

(a) Other conditions being constant, the subject is likely to 
identify himself with a character of the same sex, either one of 
his own age or a previous age, 

(b) Other conditions being constant, the subject is likely to 
identify himself with the central character of the story, that is, 
the one around whom the story revolves, whoso feelings are being 
expressed, whose behavior is being described, the one who is 
likely to be described first and figures in the ending. 

(c) Other conditions being constant, the subject is likely to 
identify himself with a character who does not have behavior 
which is socially unacceptable ‘in. the subject’s eyes,’ 

(d) The subject is more likely to be identifying with one of the 
characters when ho gives evidence of emotional involvement in 
the story he tells. 

(e) The subject is likely to identify himself with a character 
whose history is most similar to his own.* 

In the Projective Test of Racial Attitudes, it was decided that 
the ethnic group to which the subject belonged determined the 
hero or principal character. In the Spanish-Spanish and Anglo- 
Anglo situations, the dominant individual was considered the 
hero as reflected in the category ‘adequacy of the principal char¬ 
acter.’ (Adequacy of the character with whom the .subject 
identified himself.) Because of the manner in which the scoring 
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chart was set up, this technique was considered justifiable. 
Since the present investigation was concerned with prejudice, 
consistent identification of the subject with one or the other 
ethnic groups was significant in light of the five principles of 
identification outlined above. 

Following is the frame of reference for scoring the Projective 
Test of Racial Attitudes. This scoring key was set up before 
any of the protocols were analyzed. It was necessary, however, 
to add to it when new problems arose. 

KEY FOR SCORING THE PROJECTTVE TEST OF RACIA.L ATTITUDES 

The hero of the Spaniah-Spaniah or Anglo-Anglo picturea is the dominant 
individual. The hero of the Spaniah-Ajiglo situations is the ethnic group 
to which the subject belongs. If tho protocol is divided into a complete 
Anglo-Anglo and a Spanish-Anglo story, grade both categories. When 
extra scapegoat (minority group, not including Indiana), grade from stand¬ 
point of principal character and from standpoint of attitude toward minority 
group. 

Effect of Environment. —Primarily the ■environment lending up to the present 
aitviation. 

Helpful: In tho Anglo-Anglo or Spanish-Spanish situation, one betters 
the position of the other. In the Spanish-Anglo situation, the Spanish 
must help the Anglo or the Anglo must help the Spanish. In the 
Anglo-Anglo or Spanish-Spanish boy-girl situation, the girl must better 
the boy's position. If the two characters are in business together— 
helpful. 

Frustrating: Does not tend to set up a problem for tho other? Does the 
Spanish act up a problem for the Anglo in the Spanish-Anglo situation? 
Hindrance. 

Neutral: Neither helpful nor frustrating. 

Reaction to the Environment. —la the effect of the environment frustration 
provoking or not? Frustration is non-integrativc behavior, e.g., fight, flee, 
or some other overt expression of non-integrative emotion. 

Adequacy of Principal Character. —Assume that the ethnic group of the 
subject is the hero. 

Superior: Whore the hero’s will is imposed on the environment. If in 
Card II the subject puts the object in a frustrating situation that is 
superior. In games, the person in moat desirable position from sub¬ 
ject’s standpoint is superior. 

Equal: No conflict of will. 

Subordinate: Will of other member of the environment is imposed on 
tho hero. Is tho hero superior, equal, or subordinate in the environ¬ 
ment set up by the other member? 

If the boy hits the girl for fun, that is frustration. If he is chastised 
for act, that is subordination and defeat if the girl is not punished too. 
Physical, mental, skill, or any other feature is criterion of adequacy. 
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Explicit behavior alono is graded except when the subject qualifies 
behavior. Buying something for girl is not superior. 

Defeat in fight equals subordinate. Flees and gets away equals 
superior. One wins in fight one day and loses next equals equal. 
Always use one category if possible. If one wins in one thing and loses 
in another equals superior and subordinate. If one wins in one thing 
and loses in satne thing equals equal. 

Ending Hero .—Does the hero end victoriously or defeated with reference to 
the other member of the picture? 

Kon-aggresaion is indetermmant. 

If ethnic group I (Hero) has fight with ethnic group II, and wins, 
that is Victory. Then, it they are both punished for fighting by some 
member of ethnic group I, that remains Victory. If punished by some 
member of othnic group II, that is Defeat. 

Ending Theme .—Docs the story turn out socially integrated with rcfcrDnce 
to the mores of society (necessary hero to project). Transgression yields 
retrihution. Is tho super-ego developed as per tho mores of the social 
group? 

Adherence to this frame of reference is essential in the analysis 
of the protocols. 


STATISTICAL ANALYSIS OF TUB PROJECTIVE TEST OF IIACIAL 

ATTITUDES 

Belidbility .—Probably the most valid measure of leliabilifcy of 
scoring technique is to compxito tho degree of correlation between 
judgments of two or more trained analysts. In the present 
investigation, the protocols were scored independently by 
the investigator and another clinician trained in projective 
methodology. 


Table II.— Reliability of Scobinq the Piiojective Test op 
Racial Attitudes Using Sixty Spanish and Sixty 
Anglo Subjects Derived by Correlating Judgments 
OF Two Analysts 
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Table II is a presentation of reliability of scoring technique 
ascertained by correlating judgments on one hundred and 
twenty protocols of two trained analysts. 

It is noted from Table II that the Spanish protocols yielded 
slightly less consistency in judgment than the Anglo; and the 
protocols of the older subjects elicited greater error in scoring 
than the younger. The foiTier finding was possibly due to the 
subjectivity (projection) of the two analysts who were both 
members of the Anglo ethnic group. The latter was probably 
the result of increased complexity of stories elicited in the older 
age groups. 

A more thorough analysis of scoring consistency was made to 
discover the reliability of each of the columns in the scoring 
chart. 

The findings indicate no consistent variability. It is the 
opinion of the present investigator that the derived coefficients 
of reliability were, to a marked degree, attributable to the effec¬ 
tiveness of the frame of reference and would have approached 
perfect agreement if the scoring key had been adequately used. 


EFFECT OF ETHNIC GROUP OF ADMINISTRATOR ON TEST RESULTS 

After the reliability of the Projective Test of Racial Attitudes 
was established, the effect on teat results of the ethnic group to . 
which the administrator belonged was determined. It was 
realized that the results might be colored by the administrator, 
particularly if he were a stereotyped member of either of the 
two groups under consideration. 

After two weeks of in-service training including actual practice 
paralleled by instruction in theoretical background, a Spanish 
stereotype was allowed to administer a representative sample of 
tests. A larger sample would have been desirable; but, because 
of the limited number of available subjects, and the fact that 
results could possibly be colored by this variable, only one-third 
of the subjects at the eight-year level in each ethnic group were 
considered. 

An individual with the physiological characteristics of the 
stereotyped Anglo administered the test to ten subjects in each 
ethnic group at the eight-year level, andtheSpanish administrator 
to ten others. The difference between the ten Anglo administered 
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tests and the ten Spanish administered tests though manifesting 
inconsistencies (probably because of small sample) demonstrated 
no Gonstant variation. 

As a preliminary experimental procedure, the Anglo investiga¬ 
tor administered ten tests which were readministered by the 
Spanish administrator three months later. The time interval 
was to remove any effects of practice. The method was neces¬ 
sarily discontinued. The test re-test correlations, though vary¬ 
ing in theme, were not altered to a groat extent in scored form. 
The correlations with the small sample were over .80. 

With reference to the foregoing analysis, the tentative con¬ 
clusion was drawn that the ethnic group to which the administra¬ 
tor belonged was not an uncontrolled variable which must be 
considered in test interpretation. 

The Prejudice Score .—It was found that, in order to study the 
oliaracteristica of the individual protocol, a single score indicating 
extent of prejudice had to be ascertained. This was done by 
finding the per cent difference on the tabulation sheet between 
same group and not-same group categories and adding alge> 
braically. The result was a'prejudice'score. Analysis of the 
score, too, brought out the relationships existing between the 
categories of the scoring chart. 

Since the prejudice score was composite of tho differences 
between the per cents of deviate scores of the same group and 
not-same group categories, and represents a general factor, it was 
necessary to measure the significance of the contribution made 
by each difference. By 'deviate scores’ is meant those categories 
which are not neutral, equal, or indeterminate; these latter being 
non-reflective of poritive or negative attitude. 

Coefficients of correlation were between, each category con¬ 
tributing to the prejudice score minus the weight of the variable 
category. This procedure was applied at each age level for each 
ethnic group. 

It was noted that, though some categories contributed a 
negative value at some age levels, tho weighted contribution was 
sufficiently small, (it was demonstrated by experimentation) that 
little bearing on prejudice score was in evidence, 

The prejudice score proved invaluable in the analysis of other 
variables which demanded individual analysis. 
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Time .— 

(1) Reaction time. The time elapsing between presentation 
of the stimulus and the subject's first reaction to that stimulus in 
word association, Rorschach, and other projective techniques, 
is considered quite important as an indication of emotional 
arousal and blocking. 

One of the features of the Projective Test of Racial Attitudes 
was to measure the reaction time to the Anglo-Anglo (Spanish- 
Spanish) pictures and compare it with the reaction time to the 
Spanish-Anglo pictures, With reference to past use of reaction 
time, it might be expected that, reflective of increased affect 
and blocking, the reaction time to the Spanish-Anglo pictures 
would be significantly greater than reaction time to the like-group 
situations. 

Analysis of Spanish subjects revealed no significant relation¬ 
ship between prejudice and reaction time. Tests of curvi- 
lineavity demonstrated no significant deviation from recti- 
linearity, though there appeared to be a propensity for the level 
of significance of curvilinearity (x®Nyx) to increase with age. 
This would indicate some tendency for Spanish subjects of high 
and low reaction time to have less prejudice. 

In analysis of Anglo reaction time correlated with the pre¬ 
judice score, it was observed that, though none of the rectilinear 
correlations are significant, they are uniformly negative. This 
would indicate that there is a slight though consistent tendency 
to react more rapidly to emotion provoking stimuli. This is 
particularly manifest at the twelve-year level. 

Analysis of curvilinearity reinforces the tentative conclusions 
derived with reference to the progressive tendency for those 
subjects with less prejudice to elicit greater or lesser reaction 
time. With reference to the relevant literature on the signifi¬ 
cance of reaction time, no indication of similar conclusions from 
previous research has been revealed. 

(2) Total time. Total time appears particularly at the higher 
age levels, to be more reflective of emotionality than is reaction 
time. This conclusion was reached after computing the degree 
of correlation between prejudice score and total time. 

It was noted that as age increases, there was greater relation¬ 
ship existing between the prejudice score and total time. 
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Analysis of curvilinear rdationships revealed no significant 
deviation from, rectilinearity. 

(3) Reaction time and total time. In an attempt to reveal 
more of the characteristics of reaction time and total time, 
the relationship existing between the two was determined. 

The rectilinear correlation at the four-year level alone is 
significant (r =* .032), This would indicate that there is a 
definite rectilinear relationship between reaction time and total 
time only at this level. 

Curvilinear analysis shows that there is a tendency at the four- 
yoar level for those subjects with high and low reaction time 
to have the least total time. This characteristic, however, 
becomes progressively less manifest. 

Probably the most outstanding feature revealed by the curvi¬ 
linear analysis is the significant tendency (Eta := .881) at the 
twelve-year Spanish level for subjects with high and low total 
time to have low reaction time. This appears to be a recently 
acquired characteristic of the twelve-year Spanish sinco there 
is little indication of this quality at the eight-year level. There 
is a possibility that this finding may be explained in the following 
manner—the subject is emolionally aroused and reacts in one of 
two ways’. (1) By responding rapidly to the card, giving a per¬ 
functory, non-revealing response and then going to the next card 
where he repeats the performance. This would, perhaps, be 
similar to the evasive nature of the ^cheap whole’ to the Rorsch¬ 
ach. This hypothesis is given added credence when it is found 
that the individual subjects are quite consistent in the length of 
time they require on the individual cards. (2) By immediately 
seeing the added 'exerting’ possibilities in the Spanish-Anglo 
card and rapidly responding to it. This hypothesis was borne 
out by subjective evaluation. 

The rectilinear correlations appear to be least significant at 
the four-year Anglo level, (r = -.04). This is the antithesis 
of the Spanish four-year level where the relationship between 
reaction time and total time was most significant of the age 
levels, (r = .63), 

There is also indication, but at a less significant degree than 
that found in the Spanish subjects, for Anglo subjects with high 
and low total time to have low reaction time. The possible 
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explanation for this phenomenon offered for the Spanish subjeota 
may also be applied to the Anglo. 

With reference to the findings on reaction time and total time, 
it may be concluded that reaction time has no signihcance as an 
index of prejudice. Total time, however, is more significant, 
particularly at the higher age levels. 

IDENTIFICATION OP SUBJECTS WITH STEREOTYPES 

One of the features of administration of the Projective Test 
of Racial Attitudes was to present the pictures of stereotyped 
Spanish and Anglo boys and to ask the subject which one he 
most resembled. This was done to ascertain the r61e of ego in the 
development of group consciousness and group identification. 
It was surmised, too, that this procedure might throw light on the 
hero identification in the stories elicited. As has been pointed 
out, previous research indicates that ability to identify stereo¬ 
types is positively related to the extent of prejudice. 

For the purpose of analyzing this feature of the Projective 
Test of Racial Attitude, the identification of the Spanish and 
Anglo subjects with the stereotyped Spanish and Anglo drawings 
was correlated with the individual prejudice score. This was 
done to ascertain the relationship between identification and 
attitude. 

It is noted that the Spanish and Anglo subjects at the four-year 
level manifest equal ability to identify themselves with the 
ethnic group to which they belonged. The Spanish, however, 
appeared to learn more rapidly than the Anglo, the ethnic group 
to which they belonged. Only one case in each of the older 
groups failed to identify himself, though both failures were 
elicited from subjects who were typically Spanish. An analysis 
of these two isolated protocols brought out no significant qualities 
such as prejudice swing which would explain the subject's 
inability to identify himself coiTectly. 

It was noted that the Anglos, as a result of the age variable, 
learned to identify themselves less accurately than the Spanish. 
This is possibly because the physical appearance of the Anglos is 
less homogeneous than the Spanish. This factor was considered 
while compiling the data and it was revealed that those older 
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Anglos with a high prejudice score who could most conceivably 
identify themselves with the Spanish stereotype failed to do so. 

When the prejudice score was related with the self-identilica- 
tion of the Spanish four-year level, a significant correlation was 
obtained (r = —.604). The four-year level alone could be 
analyzed because the error of identification at the older age 
levels was insignificant. 

It appears that the higher the prejudice score, the less prone 
the Spanish four-year-old was to identify himself with his ethnic 
group. This feature might be explained on the basis (which is 
borne out by subjective analysis) that the Anglo have a higher 
economic standing than the Spanish, hence can have more 
material objects such as better clothes and more toys. This 
desire appears to be coupled with resentment, as the coelhoieut 
of correlation would indicate. Further understanding of this 
subject may be gained upon analysis of the Anglo four-year level. 

It is noted at the Anglo level that there is a progressive tend¬ 
ency for valid self-identification to be related to prejudice until, 
at the twelve-year level the relationship is marked (I’m, = .43). 
Similar to the correlation manifest at the Spanish four-year level, 
there is a tendency for those four-year Anglos of most accen¬ 
tuated prejudice to identify themselves as members of the 
Spanish ethnic group, possibly for the same reason suggested for 
the Spanish behavior. This surmise is supported by a typical 
statement made by a four-year Anglo whoso prejudice score was 
positive and approximated the mean for members of that age 
and ethnic group. Upon being asked which of tlie two stereo¬ 
types he most represented, he indicated the Spanish though he 
was a typical Anglo. He then volunteered the following state¬ 
ment: “I like those boys (indicating Anglo) because they (indicat¬ 
ing Spanish) won’t play with me. They (Spanish) piny a lot 
better games than the others and are stronger, but they won’t 
play with me because I’m not big and strong enough.” The 
Anglo attribution of superior physical prowess to the Spanish 
is in evidence throughout the Anglo age levels. Where it is 
looked upon with admiration by the members of the younger 
age levels, however, it is considered with contempt by the older. 
Examples of this shift are as follows: 

“I look like (indicating Anglo) and I’d rather be white; if I’d 
rather be mean and tough, though, I’d rather be (indicating 
Spanish). But I'd rather be white.” 
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“Most Spanish have better physical ability than whites.” 

“The Mexicans don’t treat you right—they fight all the time. 
They’re tough because they mature earlier than, whites, but 
they’re not as smart as whites.” 

These samples were draw from the twelve-year Anglo level 
and the responses were volunteered. An analysis of these 
specific cases did not demonstrate any marked swing of pre¬ 
judice: that is, this sensed superiority of the Spanish group was 
not reflected in greater or l^ser bias on the part of the Anglo. 

THE STEREOTYPED PlCTUBB LIKED BETTER 

In an attempt to contribute further to the understanding of the 
prejudice factor, the subjects of both ethnic groups were asked to 
indicate the stereotype picture they liked better—which one they 
would rather be like. This choice was then correlated with the 
prejudice score. 

A tendency was found in the Spanish ethnic group for those 
subjects at the four-year level who were more prejudiced, to like 
and want to be like the members of the Anglo group. Though 
this tendency is not significant, it is indicative. There appears 
to be a reversal in this attitude which is quite manifest by the 
eight-year level—both the eight- and twelve-year correlations 
are statistically significant in a portion manner. This latter 
finding would indicate that those older Spanish subjects who 
preferred the Anglo stereotype and would rather have the 
appearance of the Anglo possessed a lower than average prejudice 
factor. 

The relationship existing between the choice of stereotype with 
the prejudice score for the Anglo age levels was made. A com¬ 
parison of the reaction at the Spanish four-year level with the 
Anglo four-year level shows a marked difference between groups. 
Where the prejudice score manifested a negative correlation at 
the foui'-year Spanish level, which indicated that those subjects 
with the greatest prejudice against the Anglo liked and preferred 
to bo like the Anglo, there was a reversal of this finding at the 
four-year Anglo level which approached statistical significance 
(critical ratio at .10 level of significance). This would indicate 
that the Anglos at each age level who preferred the Spanish 
stereotype were the least prejudiced. 

As has been demonstrated in previous research, 
opinion may not be reflective of attitude. Therefore, it was 
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one of the areas of the current investigation to analyze any 
relationship which existed between opinion and attitude. 

An inconclusive tendency was manifest by the Spanish to 
become more moderate of their opinion of the Anglos with 
increase in age. A decrease in positive and negative reaction 
as maturation took place ia observable. This trend toward 
equality, however, does not appear in the Anglo group. Here, 
dislike of the Spanish increased markedly from the four- to eight- 
year level with a coneommitant decrease in columns headed 
'Liked Spanish-Anglo Equally,’ 

The next step in the analysis of the relationship existing 
between opinion and attitude was to correlate expressed opinion 
with the prejudice score of the Projective Test of Racial Attitudes. 

At the Spanish four-year level, there is a negative relationship 
between opinion and attitude, (r ** —.20), but by the eight-year 
level little relationship exists, (r« .096). Evidently, the 
significant positive correlation at the oldest ago level, (r * .71), 
is the product of recent development. 

The same trend was manifested when the Anglo age levels wore 
analyzed. The tendency, however, was not as accentuated as 
that found in the Spanish group. 

Analysis of older groups would be important to ascertain the 
relationship between opinion and attitude at more sophisticated 
levels. 

INTERNAL CONSISTENCY OF THE PROJECTIVE TEST OF RACIAL 

ATTITUDES 

Each card in the Projective Test of Racial Attitudes was 
selected on the basis of its ability to cover a particular area of the 
subject's experience range. The environmental variability was 
quite wide, and varied in complexity. 

The contribution which each picture makes to the end result 
might be valuable in determining its effectiveness, but a picture 
that has a low correlation with the group might be invaluable 
because it is loaded with an important but esoteric factor. In 
the Thematic Apperception Test, as has been previously indi¬ 
cated, it has been found that the responses to the pictures cannot 
be inter-correlated because the pictures are uneven in the type 
and amount of response they elicit and because the method 
includes isolating factors from context. 
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This rationalization is, no doubt, true, but the present investi¬ 
gator was interested in (1) noting the existence of a general factor 
and (2) ascertaining the consistency of behavior from situation to 
situation with reference to racial attitudes. The technique 
employed intercorrelates the response to each picture with the 
responses to the other five for each of the ten categories for each 
ethnic group at each age level. The aim, then, of correlating 
each picture with the others was to note the existence of a general 
factor and to determine the consistency of subject reaction. 

When the study had been accomplished and the results 
analyzed it was concluded that each picture of the Projective 
Test of Racial Attitudes had a positive relationship with the 
other pictures of the test. The degree of relationship, though 
differing, displays no consistent variation resulting from the 
influence of age and ethnic group. Though there is a marked 
general factor, each picture makes a specific contribution to the 
total prejudice score. 

SUMMARY 

Probably the most successful method of investigating attitude 
bases and development is by utilization of the projective tech¬ 
nique which makes it possible to analyze personality on a molar 
level. 

Six pictures were experimentally selected and proven to be 
adequate. They constitute the Projective Test of Racial 
Attitudes. 

Techniques of administration and interpretation were stand¬ 
ardized and rigidly controlled to eliminate uncontrolled variables 
which would invalidate results. 

Reliability of scoring the Projective Test of Racial Attitudes 
was found to he high at each age level for both ethnic groups, 

The effect on test results of the ethnic group to which the 
administrator belonged was analyzed. Upon analysis of this 
problem, the tentative conclusion was drawn that the ethnic 
group to which the administrator belonged had little bearing on 
test results and was not an uncontrolled variable which must be 
considered in test interpretation. 

It was found tliat^ in order to study the characteristics of the 
individual protocol, a single score indicating extent of prejudice 
had to be ascertained. This was accomplished by finding the 
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per cent difference of the tabulation sheet between same group 
and not-same group categories and adding algebraically. The 
result was a 'prejudice’ score, which proved invaluable in the 
analysis of other variables which demanded individual analysis. 

One of the features of tlie Projective Test of Racial Attitudes 
was to measure the reaction time to the Anglo-Anglo (Spanish- 
Spanisli) pictures and compare it with the reaction time to the 
Spanish-Ang\o pictures. "No significant rectiiinear or curvilinear 
relationship between racial attitude and reaction time was 
noted, but there was a tendency in both ethnic groups for those 
subjects with less prejudice to elicit greater or lesser reaction 
time. No indication of similar conclusions from previous 
research has been revealed. 

Total time appeared, particularly at the higher age levels, to be 
more reflective of emotionality than was reaction time. This 
conclusion was reached after correlating prejudice score with 
total time. 

The relationship between reaction time and total time was 
determined and it was found that there was a tendency for those 
subjects with high and low total time to have low reaction time. 

One of the features of administration of the Projective Test of 
Racial Attitudes was to present the pictures of stereotyped 
Spanish and Anglo boys and to ask the subject which one ho 
niost resembled. It was noted that the Anglos, as a result of the 
age variable, learned to identify themselves less accurately than 
the .Spanish. This is possibly because the Anglo physical 
appearance is less homogeneous than the Spanish. It was 
revealed, however, that those older Anglos with a high prejudice 
score who could most conceivably identify themselves with the 
Spanish stereotype failed to do so. There was indication that 
the higher the prejudice score, the less prone the four-year-olds of 
both ethnic groups were to identify themselves with their own 
ethnic group. A progressive tendency was manifest in both 
.ethnic groups for valid self-identification to be related to pre¬ 
judice score until, at the twelve-year level the relationship was 
marked. 

A tendency was found for those Spanish subjects at the four- 
year level who were most prejudiced, to like and want to be 
like the members of the Anglo group. Though this tendency 
was not significant, it was indicative. There appeared to be a 
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reversal in this attitude which was quite manifest by the eight- 
year level—both the eight- and twelve-year correlations \Yere 
statistically significant in a positive manner. This latter finding 
would indicate that those older Spanish subjects who preferred 
the Anglo stereotype and would rather have the appearance of 
the Anglo possessed a lower than average prejudice factor. 

A comparison of the reaction at the Spanish four-year level 
with the Anglo four-yeot level showed a marked difference. 
Where the prejudice score manifested a negative correlation at 
the four-year Spanish level, which indicated that those subjects 
with the greatest prejudice against the Anglo liked and preferred 
to be like the Anglo, there was a reversal of this finding at the 
four-year Anglo level which approached statistical significance 
(critical ratio at .10 level of significance). This would indicate 
that the Anglos, at each age level, who preferred the Spanish 
stereotype were least prejudiced. 

Since opinion may not be reflective of attitude, one of the 
areas of the current investigation was to analyze any relationship 
existing between opinion and attitude. An inconclusive tendency 
was manifested by the Spanish to become more moderate of their 
opinion of the Anglos with increase in age. A decrease in posi¬ 
tive and negative reaction as maturation took place was observ¬ 
able. This trend toward equality, however, did not appear in 
the Anglo group. Here, dislike of the Spanish increased mark¬ 
edly from the four-year to the eight-year level with a concom¬ 
itant decrease in columns headed ‘Liked Spanish Better’ and 
'Liked Spanish-Anglo Equally.' 

The next step in the analysis of the relationship existing 
between opinion and attitude was to correlate expressed opinion 
with the prejudice score of the Projective Test of Hacial Atti¬ 
tudes. It was found that, at the four-year level in the Spanish 
group, there was a marked negative relationship between the 
two factors under consideration, but by the eight-year level 
little relationship existed. Evidently, the significant positive 
correlation at the oldest age level was the product of recent 
development. 

The same trend was manifested when the Anglo age levels 
were analyzed. The tendency, however, was not as accentuated 
as that found in the Spanish group. 

Each card in the Projective Test of Racial Attitudes was 
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selected on the basis of its ability to cover a particular area of the 
subject’s experience range. The environmental variability was 
quite wide, and varied in complexity. 

The present investigation was concerned with, (1) noting the 
existence of a general factor, and (2) ascertaining the consistency 
of behavior from situation to situation with refereneo to racial 
attitudes. The technique employed mtercorrelates the response 
to the other five for each of the ten categories for each ethnic 
group at each age level. After this procedure was followed, it 
was concluded, that each picture of the Projective Test of Racial 
Attitudes had a positive relationship with the other pictures of 
the test. The degree of relationship, though differing, displayed 
no consistent variation resulting from the influence of age and 
ethnic group. Though there was a marked general factor, each 
picture made a specific contribution to the total prejudice score. 

1) David Krech. "Attitudes and Learning; A Methodological 
Note," Psychological Remw, Vol. 63, No. 5, September, 1946, 
p.291. 

2) The idea of scoring the thematic responses in this manner 
was procured from Ruth Clark (Genetic Psychology Mono¬ 
graphs, 1944, Vol 30j p. 47). H. A. Murray, in a recent letter 
to the present investigator, mode some specific suggestions, and 
the present investigator, after advice from L. I. O’ICelly, and 
through experimentation, developed the scoring system in its 
present form. 

3) Julian R. Rotter. "Thematic Apperception Testa: Sug¬ 
gestions for Administration and Interpretation," Journal of 
Persona%, Vol. 15, September, 1946, p. 83. 



ERROR SCORES AS A MEASURE OF CAREFULNESS 

BENJAMIN FRUCHTER* 

University of Texas 

I. INTRODUCTION 

There are a number of occupations that require extremely 
careful and meticulous work. An example is the navigator of the 
modern long-range bomber. He may be called upon to plot a 
course to hit a tiny dot of land in the broad Pacific. Miscal¬ 
culation may result in the loss of expensive equipment and the 
lives of himself and the other crew members. 

In order to test the hypothesis that there is a trait of carefulness 
and that a factor of carefulness can he isolated and identified, 
four testa were constructed. These are paper-and-penoil tests 
similar to some of the tasks of the navigator such as careful 
measuring and plotting on maps and charts and reading values 
from complicated scales. 

These tests were administered to three hundred fifty-four 
unclassified aviation students in January, 1945. The directions 
did not stress either speed or accuracy to the exclusion of the 
other. Two scores were obtained from the same administration 
of each test—the number of correct responses and the number of 
errors. It was observed that the error seores had eonsid^-rahle 
range and variability. It was also observed that when the 
correct and error scores of a teat were correlated the coefficients 
were relatively low, indicating considerable independence of the 
two scores. This suggested the possibility that the error scores 
might be functionally different from the correct-response scores 
and should be treated separately in an analysis. In order to 
examine the hypothesis that these tests measured a common 
trait of carefulness it was determined to submit them to factor 
analysis along with a number of reference tests. 

II. THE TESTSf 

1-2. Directional Plotting.—This is a test of the speed and 
accuracy with which an examinee can locate points and estimate 

* The writer wishes to express hia appreciation to Roger W. Birkman 
and William L. Grafton, for assistance with the factor analyses reported in 
this study. 

t For a more complete description of the tests see J. P. Guilford (Ed.), 
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directions on a chart. The coordinates of two points on a 
30 X 30 chart are given. The task is to (1) locate the posi¬ 
tions of the two points without making any marks on the chart, 
(2) determine the direction of the second position from the first 
in terms of a twelve-point compass rose shown at the side of the 
chart. The rights score is variable 1 and Iho wrongs scoro is 
variable 2. 

3-4. Complex Scale Heading.—This test consists of a chart 
containing seven vertical scales. For each item the examinee is 
given values on two of the seven scales. By placing a straight 
edge through these points, the examinee is to read the cor¬ 
responding value on a given one of the remaining five scales. 
The rights score is variable 3 and the wrongs score is variable 4. 

5-6. Plotting.—This test consists of a 26 X 26 chart and a 
compass rose. The examinee is given a starting point in terms of 
coordinates and told to move so many squares west, so many 
squares southeast, so many squares oast, etc., and then to rend 
the final position in terms of coordinates. The rights score is 
variable 6 and the wrongs score is variable 6. 

7-8. Plotting Accuracy.—This test is a variation of the Plot¬ 
ting test. The same kind of chart is ws^d, but three orientation 
compasses are shown as compared with one in the plotting test. 
The points on these are marked with letters rather than direc¬ 
tions. The examinee is instructed which compass rose to use 
in' each item. The rights score is variable 7 and the wrongs 
score is variable 8. 

In order to make up a matrix for analysis eleven tests, selected 
from the classification test battery routinely administered to all 
aviation students in the AAF, were intercorrclated with the 
eight scores (four rights scores and four wrongs scores) obtained 
from the carefulness testa. The list includes several apparatus 
classification tests, because they showed high correlations with 
the carefulness testa. A brief description of each of those 
reference teats follows: 

9. Rotary Pursuit.—This is a modification of tho ICoerth Pur¬ 
suit Test. The examinee tries with his right hand to keep a prod 
in contact with a metallic spot on a phonograph-type disc which 
is rotating at the rate of one revolution por second. While 

Printed Classi/icaiion TesU, Wafihington; United States Government, 
Printing Office, 1947, pp. 680-686. 
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doing this, there is a second simultaneous task for the left hand 
which requires the examinee to keep one of two keys closed in 
correspondence with one of two lights. 

10. Two-hand Coordination.—^This test consists of a rotating 
black disc on which is a small brass ‘target’ disc. The target 
disc follows an irregular path. The task of the examinee is to 
keep a microswitch in contact with the target disc as long as 
possible. The movement of the microswitch is controlled by 
turning two handles similar to those on a lathe. The handles 
turn in the opposite direction from those of a conventional lathe, 
so that those having had previous lathe experience will not have 
an undue advantage. 

11. Complex Coordination.—^This is a serial, choice-reaction- 
time test in which each stimulus is one of thirteen spatial patterns 
of three lights each. In correspondence with each stimulus 
pattern, the correct response is a unique adjustment of imitation 
stick-and-rudder controls. 

12. Rudder Control.—In this test the examinee sits in a mock 
cockpit of an airplane. His own weight throws the seat off 
balance unless he applies correction by means of a rudder-control 
mechanism. The score is the total time he keeps the cockpit 
pointed directly at a target light straight ahead. 

13. Discrimination Reaction Time.—This test was designed 
as a test of speed of decision and maction. There are four 
stimulus patterns, each consisting of a pair of lights, one red 
and one green. Corresponding to each stimulus pattern is a 
microswitch, the four switches being arranged in a diamond- 
shaped pattern. The position of each switch, upper, lower, 
right, and left, is associated with a cori-esponding direction of the 
red light with respect to tho gi’een light. The task of the 
examinee is to push the switch associated with a given lighted 
pattern. The score is the time it takes the examinee to push the 
correct switch. 

14. Finger Dexterity.—This test consists of forty-eight square 
pegs in square holes. Each peg can be grasped by means of a 
thick circular button at its top. The examinee lifts each peg 
from its hole, turns it 180® clockwise and resets it in its hole. 
The score is the total number of pegs turned in the time allowed. 

15. Speed oi IdentificBti(m.—This is a papeTf-and-pcncil test 
in which the silhouette of a plane must be matched with the 
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identical silhouette in a rotated position. The stimulus sil¬ 
houettes arc presented in groups of four and the silhouettes 
with which they are to be matched in groups of five, one being 
a mislead. The test is printed directly on an IBM answer sheet. 

16. Numerical Operations I.—^This is a simple arithmetic test 
printed directly on an IBM answer sheet. It consists of simple 
problems of addition and multiplication with answers provided. 
The examinee's task is to mark the given answer as either correct 
or incorrect. 

17. Mechanical Principles.—This test is similar to the well- 
known Bennett and Fry Mechanical Comprehension Test. The 
items are pictorial representations of simple mochanical prin¬ 
ciples. The answer choices are stated verbally. 

18. Reading Comprehension.—This test is composed of eight 
paragraphs oonoorning which thirty-six questions are asked. 
The items were designed to test ability to make valid inferences 
from the reading material as well as ability to answer more 
direct questions about content. 

19. Arithmetic Reasoning.—This test consists of thirty 
avithmotic-reaaoning problems which require a minimum of 
formal mathematical training to solve. 

HI. TUB ANALYSIS 

The rights scores and wrongs scores were obtained from the 
same administration and were separated for analysis. Failure 
to do so would result in experimentally dependent variables 
due to the fact that both scores had been taken from the same 
set of responses.* 

Two matrices were prepared for analysis. One contains the 
four rights scores of the carefulness tests plus the formula scores 
(R — .25^) of the eleven reference testa. The other contains 
the four wrongs scores plua the eleven reference tests. These 
reference tests had been analyzed several times previously and 
their factorial content for this population is relatively well 
established. They were included to facilitate cross-validation 

* For an analysis of these tests in a single matrix see J. P. Guilford (Ed.), 
op, ciL, pp. 080-094. In timt solution four doublet factors, one for each 
carefulness test, were obtained. Th<W arc spurious and resulted from the 
fact that both rights, and wrongs scores for any given test were derived from 
the same sample. 
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of factors in the two carefulnesa batteries as "vveU as with factors 
isolated in previous studies witii these reference tests,* 

The wrongs scores were reflected for correlational purposes. 
Interoorrelations of the carefulness tests and correlations of the 
carefulness tests with the reference tests are based on a sample of 
three hundred fifty-four unclassified aviation students. The 
interoorrelations of the reference testa were not available for 
this particular sample but are based on other comparable samples 
of unclassified aviation students with a total N of 1,920. The 
intercorrelations of all the variables involved in the two analyses 
are shown in Table 1. 

Each matrix of interoorrelations was factored by the centroid 
method. Six factors each were extracted from the rights and 
wrongs matrices. These factors were rotated graphically to 
“psychologically meaningful positions” in accordance with the 
principles of simple structure and positive manifold. Inspection 
of the factor plots indicated little evidence of obliqueness and an 
orthogonal reference frame was maintained. Table 2 gives the 
rotated and centroid loadings for the rights battery and Table 3 
the corresponding values for the wrongs battery. 

IV. INTERPRETATION OP FACTORS 


Rotated Factor I is interpreted in both batteries as a numerical- 
facility factor. 


Test 

1 Loading 

Rights 

Wrongs 

Numerical Operations I 

.78 

.61 

Complex Scale Reading 

.57 

.09 

Plotting 

.61 

.05 

Plotting Accuracy 

.61 

.18 

Arithmetic Reasoning 

.44 

.51 

Directional Plotting 

,39 

-.07 


All the rights scores of the cai*efulness tests have numerical 
content. This is to be expected from the nature of the tasks. 


* Ibid., chapter 28. 
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The wrongs scores do not have significant loadings on the 
numerical factor. 

Rotated Factor II is interpreted in both analyses as a psy- 
chomotor-ooordination factor. 


Test 

Loading 

Rights 

Wrongs 

Rotary Pursuit 


.56 

Rudder Control 


.42 

Two-hand Coordination 


.65 

Complex Coordination 

.43 

.57 


Four of the six apparatus tests have significant loadings on 
this factor. A similar factor has been identified several times 
previously in analyses of the aircrew classification battery.* 
Several of the carefulness tests rights scores have loadings 
approaching significance on this factor, reflecting the high cor¬ 
relations of these tests with some of the apparatus tests. 

Rotated Factor III is interpreted as a general-intellectual 
factor, possibly a combination of the general-reasoning and 
verbal factors usually obtained separately. 


Test 

Loading 

Rights 

Wrongs 

Arithmetic Reasoning 

.62 

.56 

Reading Comprehension 

.58 

.57 

Mechanical Principles 

.56 

.53 

Directional Plotting 

.44 

.14 


Only one of the rights scores of the carefulness tests has an 
appreciable loading on this factor. 

Rotated Factor IV is identified as a psychomotor-precision 
factor in both analyses. 


* Ibid., p. 8ie. 
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Test 

Loading 

Rights 

Wrongs 

Discrimination Reaction Time 

.44 

.41 

Complex Coordination 

.44 

.34 

Directional Plotting 

.38 

1 .16 

Finger Dexterity 

.29 

.44 


A similar factor has been identified in previous analyses of 
these appavatiUB tests.* The Divectional PloUing, rights score, 
apparently involves some finger dexterity. 

Rotated Factor V, rights battery, is mtovpretccl as a spatial- 
reference factor involving judgments of change of distance and 
direction. Rotated Factor V, wrongs battery, is identified as a 
visualization factor. 


Test 

Loading 

Rights 

Wrongs 

Plotting 


-.07 

Plotting Accuracy 


1 -.16 

Two-hand Coordination 


-.02 

Complex Coordination 


.13 

Rudder, Control 1 

-.04 

.42 

Directional Plotting 

.09 

.41 

Mechanical Principles 

.16 

1 


There is, so far ns the writer knows, no precedent for the 
factor interpreted as spatial-refei'ence and the identification is 
accordingly tentative. The loading of DirecUonal Plotting, 
wrongs score, on the visualization factor is of intorest. Pre¬ 
sumably the ability to visualize the compass rose on the chart 
helps to keep down the error score on that tost. 

Rotated Factor YI, wrongs battery is interpreted as a care- 

* Ibid., p. 817. 
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fulness factor. The corresponding factor in the rights battery 
is not interpreted since only one test has a large loading on it. 


Test 

Loading 

Rights 

Wrongs 

Plotting 1 

.19 

.04 

Complex Scale Reading 

.42 

.60 

Plotting Accuracy 

.16 

.57 

Directional Plotting 

.20 

.36 


The wrongs scores of the four cai'cfuliiess tests have significant 
loadings on the factor from the wrongs battery. Since a trait 
of carefulness was postulated in the construction of these tests 
the factor is so identified. The sixth factor from the rights 
battery has but a single carefulness test loaded on it. This, 
together with the fact that the second and third highest loadings 
on it are psychomotor testa (see Table 2), makes it unlikely that 
it is a carefulness factor too. The extent to which the caref ulness 
factor is common to en*or scores in other tests remains to be 
determined. 

V. DISCUSSION 

The major question which this study has attempted to answer 
is whether the error score of a speeded test contains sufficiently 
unique variance to justify its treatment as a separate variable. 
The error scores of the four experimental testa included in this 
analysis did define a new factor. Had the error scores not been 
analyzed separately, the general conclusion ^vould have been 
that no new factor resembling carefulness could be found in these 
carefulness tests. 

Thurstone* has isolated a similar factor in his analysis of 
perceptual tests. The tests were scored either per cent wrong or 
per cent omitted. He says of this: ^^The factor involved may be 
concerned with accuracy or caution. More data should be 
available on a variety of teat material for this factor before it 

*L. L. Thuratono, "The Perceptual Factor," Psychovielrika, 3, 1938, pp. 
1-17. 
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can be identified. This finding does suggest, however, that the 
relative frequency of errors may represent a unique trait," 

The previous analysis of these data, referred to above, in which 
both the rights and wrongs were included in the same analysis, 
confirms the results that the error scores do yield a unique factor 
even when the rights scores from the same tests are included in 
the matrix.* Rights scores of the Plotting and Plotting Accuracy 
tests did show slight, but probably not significant loadings (.22 
and .19, respectively) with the carefulness factor. 

It may be assumed safely that, if correlations of rights and 
wrongs scores are not high, a- fuller picture of the true functions 
measured by a test can be obtained by analyzing the scores 
separately than by analyzing formula scores. The results also 
imply that many an error has possibly been committed by com¬ 
bining rights and wrongs scores in the same formula. Unless 
the two are factorially similar the result may be very different 
than had been intended by the test-maker. In this connection, 
it is in order to suggest that if rights and wrongs scores from a 
test are considered in factor analysis or in composite predictions, 
they should be derived from separate forms in order to avoid 
spurious correlations. 

Another result of interest is the high correlation of the care¬ 
fulness tests with some of tlie apparatus tests. The earofulncss 
tests had higher correlations with the apparatus tests than with 
the other paper-and-pencil tests with which they wore correlated. 
This fact gives considerable encouragement to pj-opononis of 
the belief that many factors appearing in apparatus tasks can 
be duplicated in printed tests. 

SUMMARY 

In order to test the hypothesis that a trait of carefulness could 
be identified, four tests slmilai* to some of the tasks performed by 
the aerial navigator were constructed. Those are paper-and- 
pencil tests of plotting on maps and charts and leading values 
from complicated scales. The tests wore adminiatoroil to three 
hundred fifty-four uncla^fied aviation students in the AAF and 
separate correct-response and error scores wore obtained for 
each test. 

It was observed that the error scores had considerable range 


* Guilford, op. ail., p. 691. 
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and vai'iability and low correlations with the correct-response 
scores. It was decided to intercorrelate and analyze the scores 
to determine whether a carefulness factor could be identified. 

Eleven paper-and-pencil and apparatus tests which had been 
previously taken by the aviation students in the course of their 
classification were added as reference variables. Two matrices 
were prepared for analysis, one consisting of the correct-response 
scores of the carefulness tests plus the eleven reference variables 
and the other of the error scores plus the mference variables. 

The two matrices were factored and the factors rotated to 
simple structure. Numerical (I), psycho-motor coordination 
(II), general-intellectual (III), and psycho-motor precision (IV), 
factors were isolated in both analyses. The rights battery 
yielded a spatial-reference factor for the fifth factor (R-V). The 
fifth factor on the wrongs battery (W-V) appears to be a visuali¬ 
zation factor. The sixth factor on the rights battery had an 
appreciable loading on only one test and was not interpreted. 
The sixth factor on the wrongs batteiy (W-YI) is the careful¬ 
ness factor whose isolation was sought. 

The major conclusions are: 

1) The error scores of the four experimental tests define a new 
factor. 

2) Had the error scores not been analyzed separately no new 
factor resembling carefulness could have been found in these 
tests. 

3) If correlations of rights and wrongs scores are not high, 
a fuller picture of the functions measured by a test can be obtained 
by analyzing the scores separately than by analyzing scores 
arrived at by scoring formulas such as R - .25W etc. 

4) If rights and wrongs scores from a test are considered in 
composite predictions or factor analyses, they should be derived 
from separate forms in order to avoid spurious correlations, 
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AMERICAN COUNCIL EXAMINATION SCORE 
AND COLLEGE GRADES 
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INTHODtrCHON 

While & number of investigators have reported a relation 
between intelligence and occupation; very few have been con¬ 
cerned with intelligence as related to Uie held of specialization 
at the oollege level. One psychologist; in attempting to deter¬ 
mine whether or not intelligence increases from the freshman to 
senior year^ presented gome finding pertinent to this problem. 
After testing a Lawrence College freshman class on the 1984: 
edition of the American Council on Education Psychological 
Examination, Elory^ grouped the students according to their 
choice of major subject and subsequently combined those in 
related fields. Ho found the Fine Arts group to rank first on 
the A. C. E., followed in order by the Language Arts group 
(English, French, German, Spanish, Latin, and Greek), the 
Science group (Biology, Chemistry, Geology, Mathematics, 
and physics), and the Social Science group (Economics, Govern¬ 
ment, History, Psychology, Philosophy, Religion, and Sociology). 
Hartgon® observed that Oberlin College freshmen who subao- 
qiiently majored in the Mathematics—Science division scored 
higher on the average in numerical computations when tested by 
the Ohio State University Psychological Examination, while 
those freshmen who were to major in the Language-Litera¬ 
ture groups showed a greater initial ability in handling verbal 
relationships. 

The original purpose of the research to be reported in this 
paper was to determine whether or not women in a Liberal Arts 
College who major in one field differ in general intelligence from 
those who select another area for concentration. Finding that 
aomo departments did differ significantly from others in the 
general intelligence of their majore, we thereupon made a suiwey 
of grades by departments, since it seemed possible that students 
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of aomewliat leasei' ability would have some difficulty in making 
their grades during their first two years and would select for 
further study those divisions of instruction where the grading 
was somewhat lenient If this be the case one would not expect 
to find the various departments of different colleges ranking in 
the same way with respect to the general intelligence of their 
majors. 

PROCEDURE 

A score on the A. C. E. was used as the criterion of general 
intelligence in this study. For a number of years, the particular 
college studied has required all new students to take this test 
at a specific time during their first month of college residence. 
From the files of the Psychology Department were selected the 
names and test scores of all fi-eshmen tested in the nine years 
between 1939 and 1947. The students tested in 1939 had been 
given the 1939 edition; those tested in 1940, the 1940 edition; 

. . . and those in 1947, the 1947 edition. Over the period of 
years they were all tested in the same large lecture rooms, at 
the same time of day, and by members of the Psychology Depart¬ 
ment. As far as the writers know, no new student who was on 
the campus during the testing period has ever been absent from 
the test. 

Of the 2012 freshmen tested during the nine-year period, 1279 
were in the college during their second year, selected a major 
field of concentration during April of this year, and indicated 
that they would return for the junior year. Of this number, a 
total of twenty-seven students selected German, Greek, Philos¬ 
ophy, Physics, or Religion for specialization, and were excluded 
from our survey because of the small numbers. The total gross 
scores of the remaining 1252 freshmen were all transmuted into 
the equivalent scores of the 1943 edition and categorized accord¬ 
ing to clioicG of one of thirteen major fields. 

In determining average grades earned by students in the 
thirteen divisions of instruction under consideration, we included 
all students whose surnames began with A to L, inclusive, and 
who were in the college during their freshman and sophomore 
years between 1939 and 1947. For all divisions of instruction 
except Music and Art we have included only grades for six-hour 
courses, since the great majority of courses—other than in 
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these two departments—^in the first two years aro year-courses 
allowing six semester hours of credit,* A preliminary study of 
1340 oonsecutivo grades of students entering college between 
1939 and 1942 indicated that only thirty grades had to bo omitted 
by this procedure. These thirty totalled sixty-three hours of 
credit as contrasted to the 7860 hours included in the 1310 
grades. By our method of selection therefore we have probably 
included all but one per cent or less of the credits earned in the 
eleven divisions of instj'uction.j In Art and Music, all grades, 
regardless of hours’ ci*edit, were included with the exception of 
Choral Music which we excluded from our tabulations. 

Ordinarily a student was given one final grade for the year's 
work in a course (six hours); however, if tho two Bemosters’ 
grades were recorded separalcly, the second grade, if not tho 
same as tho first, Avas arbitrarily taken as the grade. Further¬ 
more, if a student dropped a given year course nt the end of the 
first semester or at any other time with a record of D or F, the 
D or F was included just as if she had remained in the course 
throughout the year. 


RBStlliTS 

In Table 1 are included tho number of majors in each of the 
thirteen divisions of instruction from 1939 to 1947, the mean 
gross scores and SD’s of those students losled on the A. C. E. 
at the beginning of the freshman year, and the percentile ranks of 
these means as derived from th© national norms. The A. C, E. 
means range from 133-50 for those students who later selected 
French as a major, to 119.07 for those who subsequently majored 
in Biology, the respective percentile ranks of the groups ranging 
from. 86 to 68. The Music majom were most variable in their 
A. C. E, scores, as indicated by a standard deviation of 22.83, 
followed by English, History, and French; the SD's of the other 


* In tho Art Department the courses arc primarily four-hour courses. 
In Music likcwiflo the great majority of classes open to frc-shmcn and sopho¬ 
mores aro fouv-liour courses. 

IThc omitted BrndcB were from the tottowing dWiBionB of mstruction: 
English, French, History, hatin, Mathematics, Political Science, and 
Spanish. 
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nine groups were very similar, all of tiiem being between 17 
and 18. 

No significant differences wei-e found among the freshman 
scores of groups who subsequently elected to major in Fi'encli, 
Mathematics, Chemistry, Spanish, Art, Psychology, and Latin, 

Table 1.— Mean Gross Scores, Standard Deviations, and 
Percentile Ranks ok Freshmen Tested by the A. C. E. 
PROM 1939 TO 1947 and Grouped according to Subsequent 
Choice op Major' 


Major 

N 

Mean 

Percentile 
SD Rank^ 

Art 

31 

127.81 

17.16 

80 

Biology 

101 

119.07 

17.32 

68 

Chemistry 

119 

129,98 

18,04 

82 

Economics & Sociology 

151 

120.93 

17,74 

71 

English® 

299 

121.65 

19.30 

72 

French 

54 

133.50 

19.07 

86 

History 

100 

121.68 

19.20 

72 

Latin 

68 

126.33 

17.52 

77 

Mathematics 

104 

131.02 

17.86 

83 

Music 

33 

12Q.QQ 

22.83 

77 

Political Science 

67 

119.37 

17.86 

69 

Psychology 

84 

127.68 

17.82 

79 

Spanish 

61 

128.41 

17.28 

80 


1 All indLvidiml scores were transmuted into equivalent scores for 1943. 
All choices of major subjects were made iu the Spring of the students' 
sophomore year; however students who changed their major during their 
junior or senior year were placed according to their final choice, 

* Norms based on 31,930 freshmen from two hundred forty-one colleges.’ 

3 The departments of English Literature and English are combined in 
this study. Sociology is combined with Economics since for the greater part 
of the years covered they were Included within a single department, 

at the one, two or five per cent level of confidence. Likewise 
none of the differences between the means of the groups who in 
their second year chose to major in History, English, Economics 
and Sociology, Political Science, and Biology proved to be 
significant at any of the three levels of confidence. However, 



296 


The Jouryial of Educational Psychology 


the Freiich, Mathematics, Chemistry, Spanish, and Psychology 
majors proved to have made significantly higher means (one 
per cent level) than the students who selected Biology, Political 
Science, Economics and Sociology, and English. The means of 
the French, Mathematics, and Chemistry majors were also 
significantly higher than the History mean (one per cent level), 
while the Spanish and Psychology means wore significantly 
higher than the History mean at the five per cent level of con¬ 
fidence. The means of the Art and Latin majors were signifi¬ 
cantly above those of Biology, Political Science, and Economics 
and Sociology at either the two or five per cent level of confidence. 
Music majors were found to be neither significantly higher nor 
lower than any other group of majors at the tliree levels of 
confidence employed. 

In Table 2 arc included 7997 grades of freshman and sophomore 
students, earned between 1939 and 1947 and separated according 
to the thirteen divisions of instruction under consideration. 
As will be observed from tho tabic, the moan grade ranges from 
3.72 in Art* to 3.18 in French, Psychology, and Spanish; the 
standard deviations ranging from 1.17 in French to 0.78 in 
Biology and English. 

The divisions of instruction may be conveniently divided into 
two groups; the eight ‘higher-grading' and the five ‘lower- 
grading.' The higher-grading divisions of Art, Latin, Music, 
Political Science, English, Economics and Sociology, Biology, 
and History were all significantly above (one per cent level of 
confidence) the five divisions of French, Spanish, Psychology, 
Mathematics, and Chemistry. None of the lower-grading 
divisions differed significantly from one another, but among the 
higher-grading groups the means of Art and Latin were sig¬ 
nificantly above (one per cent level) those of History, Biology, 
Economics and Sociology, and English. The Art mean grade 
was also higher than that earned in Political Science (one per 

* Probably ono would expect the Art tvnd Music grades to average higher 
than those in tho other divisions of instruction, since those two arc tho only 
'purely elective’ courses among the thirteen divisions. In order to graduate 
a student must havo successfully completed courses in English; History; n 
foreign language or languages; Chemistry, Mathematics, or Physics; 
Biology or Psychology; and Economics, Sociology, or Political Science. 
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cent level) and higher than the Mn^c mean (five per cent level of 
confidence). 

It will be observed that the five groups whose means were the 
lowest on the A. C. E, all selected their major fields of concen¬ 
tration from among the eight higher-grading divisions of instruc¬ 
tion. Likewise five of the seven groups who scored relatively 


Tabue 2.—Means and Standard Deviations of Freshman 
and Sophomore Grades from 1939 to 1947 Grouped 

ACCORDING TO DIVISION OF INSTRUCTION* 


Division of Instruction 

N 

Mean* 

SD 

Art 

160 

3.72 

0.92 

Biology 

589 

3.41 

0.78 

Chemistry 

669 

3.25 

0.96 

Economics Sociology 

460 

3.42 

0.79 

English 

1389 

3.46 

0.78 

French 

760 

3.18 

1.17 

History 

1007 

3.40 

0.93 

Latin 

603 

3.61 

0.90 

Mathematics 

760 

8.23 

1.04 

Music 

370 

3.52 

0.99 

Political Science 

328 

3.47 

0.82 

Psychology 

341 

3.18 

0.91 

Spanish 

772 

3.18 

1.04 


‘ Including only grades of students whose surnames began with A to L 
and who were in GoUege for two or more years. 

* Letter grades of A, B, 0, D, and F were arbitrarily numbered 6, 4, 3, 
2, and 1, respectively. 


high on the A, C. E. subsequently selected their major field 
from among the five lower-grading divisions of instruction. Only 
in the case of the Art and Latin departments do we find relatively 
high-scoring A. C. E. groups choosing their major fields from 
the higher-grading divisions. The coefficient of correlation by 
the Product-moment method between mean A. C. E. scores of 
majors and the mean grades of freshmen and sophomores in the 
same division of instruction is — .44. 
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SUMMARY AND CONCLUSIONS 

1) All freshmen in a southern Liberal Arts college for women 
wete given the American Council Examination from 1939 to 
1947. Among these students tested there were 1279 who were 
enrolled in the college during their sophomoro year, selected a 
major field for concentration, and indicated their intention of 
returning for their junior year. 

2) Twelve hundred fifty-two of the sophomores selected one 
of thirteen divisions of instruction for their major. The 
freshman A. C. E. scores of this number were transmuted into 
equivalent scores of the 1943 edition. 

3) The seven higher-scoring groups, determined by their means 
on the A. C. E., wore; French, Mathematics, Chemistry, Spanish, 
Art, Psychology, and Latin. None of these groups differed 
significantly from one another. 

4) The five lower-scoring groups, determined by their A. C. E. 
means, Avere: History, English, Economics and Sociology, Politi¬ 
cal Science, and Biology. No significant differences were 
obtained among these means. 

6) The Music majors, the most variable of the groups, did not 
differ significantly from any of the other twelve groups. 

6) Five of the higher-scoring groups, i.e., French, Mathematics, 
Chemistry, Psychology, and Spanish majors, earned significantly 
higher test means than the five lower-scoring groups. 

7) Approximately 8000 grades secured from 1939 to 1947, 
the great majority of which indicated six semester hours of 
Avork, were tabulated according to the thirteen divisions of 
instruction. These AA'cre selected by recording the freshman 
and sophomore grades of all studente Avhose surnames began 
with A to L inclusive and avIio attended the college for tAVO or 
more years. 

8) The grades of eight divisions of instruction were significantly 
above those of the other five, on the average. The five lower- 
grading divisions were those of Fi'cnch, Mathematics, Chemistry, 
Psychology, and Spanish, 

9) Except for the departments of Art and Music, in which 
none of tho courses arc required and to Avhich special talents 
might be expected to direct students, and Latin, there appears 
some evidence of an inverse relation between mean A. C. E. 
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score of majors and mean grade earned by beginning students 
in the field. The divisions of instruction in which freshman and 
sophomore students were graded lowest on the average, i.e., 
Chemistry, Mathematics, Spanish, Psychology, and French, 
were those that had majors who ranked on the average between 
the 79th and 86th percentiles on the A. C. E.; whereas the 
departments that graded their freshmen and sophomores some¬ 
what higher, i.e., Biology, Economics and Sociology, English, 
History, and Political Science, had majors who on the average 
ranked between the 68th and 72nd percentiles on the A. C. E. 
It would appear therefore that choice of major subject beara 
some relationship to students’ A- C. E. scores and to the average 
grades of those enrolled in the more elementary courses. 

10) By combining ‘related fields’ as Flory did, we find our 
results to be in agreement with this investigator only insofar as 
the Social Science group scored lowest of the four divisions. 
Since the ranking of the other three divisions is at variance with 
that of Flory, it is quite probable that the agreement in the 
Social Science division is fortuitous. 
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THE RELATION BETWEEN INTELLIGENCE AND 
ACHIEVEMENT TEST RESULTS EOR A GROUP OP 
COMMUNITIES^ 

ROGER T. LENNON 

Director, Division of Teat Research and Service, 

World Book Company 

What is the relation between tiie intelligence level of the ele¬ 
mentary-school population of a community and its achievement 
as measured by standard achievement tests? la this relation 
the same from grade to grade or does it tend to increase or 
decrease with additional achooling? Does this relationship 
vary from subject to subject and, if so, in what manner? These 
are questions of considerable theoretical importance and not 
without practical significance, particularly with reference to 
such matters as the provision of separate achievement test 
norms for,communities or schools of varying intelligence levels. 
This paper presents data on the relationship between achieve¬ 
ment and intelligence as measured by standard tests, for suc¬ 
cessive grades and for some important subjects in the elementary 
school. 


SOURCE OP DATA 

The data reported were obtained in connection with the 
standardization of the new (1946) edition of the Metropolitan 
Achievement Tests. They are based on the results for seventy 
of the two hundred fifty communities which participated in the 
standardization program; these seventy are communities in 
which all public school pupils in grades II through VIII (or IX, 
depending on the organization of the system) were tested, and 
exclusive of very small communities whose results are based on 
such few cases as to be of very limited dependability. The 
communities, however, are for the mr^t part, small ones; about 
two-thirds are of less than ten thousand population. They are 
drawn from thirty-six states. The pupils in the various grades 
took the appropriate battery of both the Pininer General Ability 
Test series, and of the Melropolilan series, as listed in Table 1. 

^ Paper read at the April, 1940, meeting of the Eastern Psychological 
Association, Springfield, Mnasaohuaetts. 
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All tests were administered within two months of the opening 
of schools in the fall of 1946. The figures reported are based on 
an analysis of a random sample of approximately twenty-five 
per cent of the total number of cases in each coramimity; for this 
random sample the mean IQ for each grade in caeh community 
was computed, together witli the mean standard score in each 
subtest of the Melro'polilan Achiedcmenl Tests for each grade. 
It is the relationships among these community averages which 
are here discussed. 

Tablh 1.— Battehtes op AfetropoliCan Achievement Tests and 

Pininer General Ahilily Test Used in Various Grade Levels 
IN Methopolitan Standardization Program 

- , MelTopolilan Achieoemenl Pininer General Ability 

Tests Test 

II Primary I: Word Picture, Pintner-Cunningham Pri- 
Word Moaning, Word Rcc- mary Test, Form C 
ognition, Numbers 

III Primary II: Reading, Word Pintner-Durost lOIemcn- 
Mcaning, Arith. Fund., tary Test: Scale I (Picture 
Arith. Prob,, Language Content), Form B 
Usage, Spelling 

IV Elementary: Reading, Vo- Pintner-Durost Elemon- 
cabulary, Arith. Fund., tary Test; Scale II (Read- 
Arith. Prob., Language ing Content), Form B 
Usage, Spelling 

V-VI Intermediate: Reading, Pintner General Ability 
Vocabulary, Arith. Fund., Test: Intermediate Form 
Arith. Prob., English, Lit- B, Verbal Series 
erature. History, Geog¬ 
raphy, Science, and Spell¬ 
ing 

VII-IX Advanced: Reading, Vo- Pintner General Ability 
cabulary, Arith. Fund,, Test: Intermediate Form 
AriUi. Prob., English, Lit- B, Verbal Series 
erature, Histoiy, Geog¬ 
raphy, Science, Spelling 
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The basic data of this paper are summarized in Tables 2 and 3. 
Table 2 presents the correlations between the average intelligence 
level (mean IQ) and average achievement level for each grade 
and subject. In all grades except grade IX these correlations are 
based on 70 communities; in grade IX they are based on 39 com¬ 
munities; Table 3 presents for each grade the means and 
standard deviations of the achievement and intelligence test 
distributions; it is to be noted that these are for distributions of 
community means, not of individual scorns. 

SUMMARY OF FINDINGS 

Examination of the data presented in Table 2 indicates that 
all relationships between intelligence and achievement test 
scores reported are positive; at grade IV and above, with a few 
exceptions, they are significantly so. (For N = 70, as here, r 
must equal about .30 for significance at the 1 % level.) This is 
entirely in accord with expectation, although the magnitude of 
the correlations at the lower grades is perhaps not so great as 
would have been anticipated. The correlations range from .11 
between IQ and what we have called Arithmetic Fundamentals 
(really Numbers) at the second grade level, to .86 between IQ 
and Vocabulary score at the eighth grade level; the median 
value for all correlations is approximately .60. That is to say, 
in general there is a marked tendency for communities which 
are above average in IQ to be above average also in achievement, 
as measured by these tests. 

If we turn our attention to the manner in which these relations 
vary from grade to grade, we note a marked tendency for the 
correlations to increase as one goes up through the grades; this 
is clearly revealed by inspection of the right-hand column of 
Table 2, in which the average value of the correlations for the 
respective grades is shown. These data indicate that at the 
second- and third-grade levels, knowledge of the average intelli¬ 
gence test scores for pupils in a community would enable one to 
improve the prediction of the community’s achievement status 
but slightly, if at all. At the upper grades—VII, VIII, and IX—■ 
on the other hand, the tendency is much more pronounced for 
the communities with high average IQ's to be also the high- 
achieving communities. 
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Table 3 ~Mms ap SrAmAM DMinoss of CoMpfirr Mm Stamhabd ScobeSj bt Grade, on 
Sdbtests op the Jlfelropolitm Adiwmt Tests 

Subject 


Grade 

Rding 

Word 

Meaning 

AiiOh, 

Mi 

Aritb. 

Prob. 

Spelling 

EngM 

Litera- 

tme 

History- 

Civics 

Geog¬ 

raphy 

Science 

IQ 

iMean 

a 

Mean 

I f 

Mean 

c 

Mean 

f 

Mean 

ff 

Mean 

t 

Me^ 

n 

Mean 

tf 

Mean 

s 

Mean 

(T 

Mean 

r 

II 

HI 

IV 

V 

VI 
VH 

vin 

U 

112,5 
HI, 2 
m,9 
im 
194.7 
204.3 
214.9 

m 

5.8^ 

5.7 

7.1 

8.1 
7.4 
;7.5 
7.1 
U 

121.2 

142.6 

165.7 
179.2 
|195,C 

204.7 
■216.0 

6.2 

5.9 

6.6 

7.6 

8.0 

7.3 

7.2 

U 

137.2 

137.8 

154.7 

171.6 
195.4 

m 

242.7 

3.2: 
2.5' 
5.1 
6.3 
■10.4 
9.4 1 
12.3' 
J4.J| 

149.4 

165.8 
178.6 

195.2 

211.2 

223.8 
235.5j 

2.6j 

4.1 

4.9! 

:6.8 

7.2j 

,9.3' 

'5.4| 

142.7 

163.7 

179.6 
jl96.6 
210.1 

1228.6 

b.o 

6.7 

7.7 
6.2 
j6.3 

b 

|8.4 

b 

164.3 

177.91 

195.8 

'205.5 

222 . 4 ! 

7.1 
6.5 

8.2 

■j0.2| 

,197 .S 
'206.4 
216.9 
■m.i 

7.1 

b 

.8,6 

n 

199.1 

207.8 

218,0 

334.S 

|7.4 

b 

8.4 

'1 

w,i 

308,5. 

216 , 9 ! 

323,2j 

7.6 

s-i| 

9.9 

9.2 

,199.5 

m 

224 . 5 ! 

!234.0| 

|8.7' 

Ij.s. 

,10.1^ 

!0.I| 

100 . 7 ' 

100.7 

98.3 

100.7 

99.5 

9S.9 

99.5 

100 

7.2 

5.5 

6.9 
6.0 
6.0 

5.9 
5.9 
5.5 


^ Word Necognitico Test, 
* Numbers Test 


Itclat^orh JTvielliffGnc^ and ^est- R^sttlis 30& 
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This apparent change in the relationship between upper and 
lower grades may be to some extent an artifact, reflecting diffei*- 
encea in the content of the intelligence Losts used. In the second 
grade, the Pintner-Cunningham Test was used, and in the third 
grade. Scale I, the Picture Content Scale, of the Pinlner-Durosl 
Elementary Test was used. Both of these are non-reading testa 
and measure abilities that bear little resemblance to school work; 
whereas the teats used in grades IV to IX are verbal tests, whose 
subtests include, among others, arithmetic problems, vocabulary, 
opposites, and number sequence tests, which are obviously 
influenced by school experience. Hence, it is not surprising 
that the intelligence and achievement test results for grades IV 
to IX should agree more closely than in the earlier grades. How¬ 
ever, this would seem to be but part of the story, for even between 
the fourth and the ninth grades, in which range the same intelli¬ 
gence test was used, there is a steady inGmasG in the degree of 
coi'respondence between the two sets of scores. One could 
argue that the intelligence test results are becoming progressively 
more dependent on, more a reflection of the influences of, school¬ 
ing; but there is nothing in the data to show in which direction 
causative influences, if any, are operating. 

A second hypothesis would bo that the increasing correlation 
betiveen average IQ and average achievement with increasing 
schooling is in part a function of greater variability in either 
measure as one goes up through the grades. The data in Table 3 
lend some support to this belief. The variability of community 
mean IQ's remains quite constant throughout the grades, to be 
sure, but there is a clear tendency for the communities to become 
more variable in achievement at the higher grades, as examina¬ 
tion of the standard deviations reveals. 

What of the relation of community mean IQ to community 
performance in the separate subjects? For communities, as for 
individuals, there arc marked dilTeronccs among subjects at all 
grade levels. In general, Ihe p'eatost correlation tends to bo 
between the reading measures and the intelligence measures; 
at the seventh-, eighth- and ninth-grade levels, tliese correlations 
almost approach the magnitude that one would expect to find 
between two measures of intelligence or between two reading 
tests. Thus, knowing the average intelligence level of pupils 
in these grades, as measured by the test® used, one could estimate 



Relation between Intelligence and Test Results 307 

■with considerable accuracy their average reading achievement, 
or vice versa. The correlations tend to be smallest between IQ 
and what we may term the subjects, namely, arithmetic 

and spelling; for Arithmetic Fundamentals in grades II to VI, 
knowledge of intelligence is of little help in predicting achieve¬ 
ment. At the lower grades the correlations between Arithmetic 
Fundamentals and IQ are significantly smaller than the cor¬ 
relations between Arithmetic Problem Solving and intelligenco, 
but this is not the case in grades VII to IX. Between the reading 
tests, on the one hand, and the ‘skill’ tests on the other, are the 
so-called ‘content’ subjects—Literature, History and Civics, 
Geography and Science; the correlations iietweon community 
means in these subjeefca and intelligence range from .50 to .77. 

The attempt to relate achievement measures to intelligence 
teat results has been of persistent concern to test-makers and 
test-users—and legitimately so, for the desire to evaluate an 
individual’s performance in terms of his ‘capacity’ is a praise¬ 
worthy one. Accomplishment quotient techniques and cognate 
devices represent one approach to this problem, albeit eenreoly a 
satisfactory one. The provision of separate norms for the 
interpretation of .scores for individual pupils of varying IQ levcla, 
as is done for certain achievement tests, represents another 
approach. Borne wi'iiera have suggc.Hioil that- it irouJd ho 
desirable to provide achievement test norms for school systems 
of varying intelligence levels on the ground tliat sucli norms 
would permit the school administrator to compare achievement 
in his system with achievement in systcm.s whoso pupils are 
similar in intelligence. This suggestion assumes tiiat variation 
in the average intelligence level is associated wiili variation in 
achievement to a degree sufficient to make it wortli while for 
practical purposes to establisli differentiated norms; as mentioned 
in the opening sentences of this article, the data herein reported 
are relevant to this question. 

The data presented in Table 2 indicate, in the writer’s 
judgment, that in grades II tliroiigh V, at lea.sl, the relationships 
between the intelligence and achiovement levels of a community, 
with the single exception of those for reading, are not H\ifiiciontly 
large to warrant the establishment of di/Tercntiated norms for 
school systems of varying average intelligence levels. In grades 
VI through IX the correlations, with the exception of tlioso for 
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ai’ithmetic, HpclUng anti ^English, nro of sucli magnitude that 
one may expect communiUca scoring high in intelligence teats 
also to do well on aohievemont teats witli consiclorable conaiatciicy. 
If the magnitude of this rclationship wore the only factor to bo 
consideved in determining the desirability of differentiated 
norms, one could argue in favor of such norma at the upper 
grades except for the Bubjoels named. 

There are, however, other elements to be considered in decid¬ 
ing, both on practical and theoretical grounds, whether separate 
norms of this character arc desirable. From a practical stand¬ 
point, the provision of multiple sots of norms is o.xponsivo, both 
in terms of the cost of obtaining adequate data and In terms of 
making the additional normative data available; and it is doubtful 
that there is suflicient sopliistication on the part of the ordinary 
test-user to make it likely that sucli differontiated norms would 
be generally understood and properly used. On theoretical 
grounds, we might cite the problem of the validity of most 
currently available intelligence tests as mcosuros of 'capacity' 
in any real sense, and the corollary problem of the community 
of function measured by present iiitcUigcnce and achiovenicnt 
tests. Even if the practical problems in the construction and 
use of differentiated norms could be coped with successfully, 
the theoretical justiftcation for such norms seems, to the writer, 
dubious to say the least. 



A STUDY OF HIGH-SCHOOL ACADEMIC INDICES 
AS A CRITERION FOR COLLEGE ADMISSION 


ISMAEL RODRIGUEZ BOU and FRANKLIN L. STOVALL 

Superior Educational Council 
University of Puerto Rico 
Rio Piodras, Puerto Rico 

INTBODUCTION 

One of the many problems with which the University of Puerto 
Rico is faced is that of selecting wisely and well its student body 
from among the numerous individuals who desire to enroll. 
This problem exists even now and, without a doubt, will become 
more serious in the future. At present, the University and other 
institutions of higher learning on the Island are not able to 
accommodate all persons who desire to matriculate. Some kind 
of a screening process seems necessary in order that these institu¬ 
tions shall be able to admit those people who can profit to the 
greatest extent from college training. 

In such a screening process many factors must bo taken into 
consideration in order that those individuals who must be 
screened out or eliminated (if such be the case) will be the 
individuals who are least likely to succeed at the college level. 
One of the factors which has earned most weight in the selection, 
of students by institutions of higher learning has been and still 
is the factor of high-school grades or previous academic record. 
The University of Puerto Rico prior to the school year 1946-47 
used this factor as a sole criterion for selection. 

How reliable is such a criterion? To what degree of accuracy 
is it possible to predict college grades from high-school grades? 
Are letter grades of *A,’ ‘B,* 'C,’ etc. from the various high 
schools of Puerto Rico equivalent? Do those individuals with 
the same letter grade averages in high school possess approxi¬ 
mately the same degree or amount of preparation for college 
work? 

In order to obtain more accurate and reliable answers to these 
and similar questions it was decided to make a comprohensivo 
and scientific study of the problem. Accordingly, a study was 
sponsored by the Supeilor Educational Council of the University 
of Puerto Rico with Dr. Ismael Rodriguez Bou, Permanent 
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Secretary, as Director. This paper is in the form of a summary 
report* of the study—the purpose, methods and technique, the 
presentation and analysis of data, the conclusions and, finally, 
the recommendations. 


PURPOSE 

The purpose of this study was two-fold: 

1) To evaluate the high-sehool academic record ns n criterion 
for admission to college. With what degree of accuracy is it 
possible to predict grades in the University of Puerto Eico from 
grades made in high school? 

2) To determine the relative importance of letter grade 
averages as given to students by the teacliers of the various high 
schools of the Island. Is an ‘A’ or 'B' grade in one high school 
equivalent to an ^A’ or ‘B’ grade in some other high school? 
Are students from different high schools with the same letter 
grade averages equally prepared for academic work in college? 

METHODS AND TECHNIQUES 

In the initial stages of this study, the grades made in the 
University by eight hundred fifty-three freshmen just out of 
high school (fifty-seven different schools) who were enrolled in 
the University during the year 1945-46 were obtained along with 
their respective grades in high school. The University grades 
made by each student in all courses completed during the 1946- 
46 school year were averaged in order to get an average grade for 
each of the eight hundred fifty-three freshmen included in 
the study. Similarly, an average of high-school grades was 
computed for each student. In computing the University and 
hlgh-school averages an ‘A’ was given the value of 4, a 'B' the 
value of 3, a 'C' the value of 2, a ‘D’ the value of 1, and an. 'F' 
a value of 0. The lowest high-school grade point average of 
any student was 2, for students with less than a ‘O' average in 
high school are not admitted to the University (except veterans 
who pass a special examination). 

These averages were then compared and a coefficient of correla¬ 
tion computed. A regression equation was worked out by means 

* A complete comprebensivo detailed report of this abudy lias been pub¬ 
lished as English and Spanish Editions by tho Superior Educational Council 
of Puerto Rico. Copies arc available upon request. 
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of which University grade point averages were predicted from 
high-school grade point averages. The predicted grades were 
then compared directly with the grades actually made in the 
University and the extreme variations noted. An attempt was 
made to relate these extreme cases to particular high schools. 

Some months later the study was extended to include an addi¬ 
tional group of one thousand one hundred fifty-seven stu¬ 
dents who had matriculated in the University for the school 
year 1944-45 and who had come directly from the higli schools of 
the Island. The same methods and techniques employed in an 
analysis of the grades of the eight hundred fifty-three stu¬ 
dents were used in dealing with this last group of one thousand 
one hundred fifty-seven students. 

Also, it was possible still later to study in the same manner 
two hundred forty-eight and two hundred thirty-four students 
who entered in 1944-46 and 1945-46, respectively, the College of 
Agriculture and Mechanical Arts of the University of Puerto 
Rico, located at Mayagdez. Then one hundred eight students 
who were freshmen at Polytechnic Institute in 1946-46 were 
included. Finally, the combined total of two thousand six 
hundred students was studied.* 

DATA FROM 2,600 CASES 

Averages of high-school academic indices and University grade 
points for the several clas.s groups (a total of 2,D00 cases) are 
given in Table I along with the standard deviations and coefii- 
cients of correlation between high-school indices and grades 
made in college. Since high-school graduates who have less 
than a ‘C’ average in all their high-school work are not admitted 
to the University of Puei'fco Rico and to Polytechnic Institute, 
the high-school academic indices for the above groups range from 
2.00 to 4. In effect, then, the students admitted to college in 
Puerto Rico come from the upper or ‘right’ half of at least 
approximately a normal distribution representing the total of all 
high-school graduates for the years involved. Grades made in 

* The data here deal only with the combined total of all cases and vepre- 
Bont graduate.^ of seventy-three different high schools in llie Island, both 
public and private. The total, however, includes six students at Polytechnic 
Institute who graduated from high school outside of Puerto Rico. 
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college, however, range from 0 to 4 and follow a normal curve of 
distribution. 

Some interesting comparisons are possible by an examination of 
Table I. Columns 2 and 3 give the means or arithmetic aver¬ 
ages of high-school and college indices. The mean high-school 


Table I.—Means, Sigmas, and Coeppigients op Correlation 
Computed for the Several Groups ■ 



Means 

Sigmas 

Groups 

High 

School 

Uni¬ 
versity 
^ Grades 

High 

School 

Uni¬ 

versity 

Grades 

r's 

University (863) 

2.74 



IB 


University (1157) 

2.69 

1.97 


mSl 


Total! 2010 

2.71 

2.07 

0.B3 

0.74 

0.64 

College of MayagUez 
(248) 

College of Mayagilez 

2.48 

2.18 

0.64 

0.60 

0.62 

(234) 

2.45 

2.01 

0.69 

0.79 

0.70 

Total: 482 

2.47 

2.10 

0.B7 

0.70 

0.62 

Polytechnic Institute 






(108)* 

2.93 

2.21 

0.51 

0.60 

0.64 

Grand Total: 2600 

2.67 

2.08 

0.53 

0.73 

0.57 


* Includes six students who graduated from liigh achools outside of 
Puerto Rico. 


index for students enrolling in the University of Puerto Rico 
(2,010 cases) 18.2.71, for the College of Agriculture at MayagUoz, 
2.47 (482 cases), and for Polytechnic Institute at San Germfin, 
2.93 (only 108 cases for one year). The average high-school 
index for all 2,600 cases (including six students at the Institute 
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who graduated from high school outside of Puerto Rico) is 2.67, 
or a low ‘B’ average. The mean college index for the University 
ia 2.07; for the College of Agriculture, 2.10; for the Institute, 2.21; 
and for all combined, 2.08. In columns 4 and 5 of Table I are 
given the corresponding standard deviations. 

In the last column of Table I the coefficients of correlation 
between high-school and college indices are listed. The averages 
of these coefficients were computed by squaring each coefficient, 
securing an average of these squares, and extracting the square 
root. The coiTclation for the University and the Institute are 
the same, .64. The correlation for the College of Agricultiii'e is 
the highest, .62. The coefficient of correlation for all 2,600 
cases combined into one large sample is .67. All of these coeffi¬ 
cients are positive and satistically significant, but they are quite 
low for purposes of prediction. When regression equations were 
worked out, the error of prediction was so large that for practical 
purposes it is difficult to predict accurately college grades from a 
knowledge of the high-school grades. This moans then that high- 
school indices as a criterion for the selection of college students is 
not very reliable, especially in regard to students with a low 
‘0,’ ‘0,’ or high 'O' average. 

Table II lists the sevonty-threo public and private high schools 
which constituted the source for the student groups studied. 
The total number of students and the average high-school index 
for all the students from each particular school are given in 
columns 2 and 3. In column 4 the actual grade point averages 
earned by students during their first year of college are listed. 
The grade point averages in Column 5 were predicted from a 
regression equation. For the individual, the error of estimate is 
so high that knowledge of the student's high-school index does 
not enable one to predict with any degree of accuracy the degree 
of success he may attain in college. The differences in grades 
actually obtained and grades predicted by means of the regres¬ 
sion equation are shown in the last column of the table. Tho 
range of these differences is all tlie way from +1.43 (one studont 
from a small private school) to —0.84 (one si.uclont from a small 
public school). A study of this column of difFcrcnccs reveals 
that students from tho largest high schools and a majority of tho 
private schools on the whole make better grades in college than 
predicted for them on tho basis of the regression equation. 
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Table II,—A Compaihson op this Actual and Predicted 
University Ghadeb by Towns 


Town 

1. Adjuntaa 

2. Aguada 

3. Agiiadilla 

4. Aibonito 

6. Arccibo 

6. Bayamdn 

7 . Cabo Rojo 

8. Caguds 

0. CQn6vanas 
10. Carolina 
n. Cayoy 
12. Ci^OB 
18. Coamo 
14. Comovfo 

16. Corozal 
10. Fajardo 

17. Oudnica 

18. Guayama 
10. Hormjguoros 

20. Humncao 

21. Isnbola 

22. Jayaya 

23. Juana Diaz 

24. Juncos 
26. Parcs 

26. Manati 

27. MayagUez 

28. Orocovis 

29. Ponce 

30. Rio Gronclfl 

31. Rio Pledrns (U.P.R.) 

32. R. Piedras High School 
S3. R. Piedras (Montalvo) 

34, Salinas 

86. San Germdn 

36. S. Juan (Superior Central) 

37. S. Juan (Superior NocLurna) 

38. S. Juan (Ncgoc. Adultos) 

80, San Scbastidn 

40. Toa Baja 

41. UWado 

42. Vega Baja 


No. of 



Pre¬ 


Stu¬ 

H-S 

Grades 

dicted 

Differ¬ 

dents 

Index 

in U. 

Grades 

ence 

11 

2.02 

2.21 

2.20 

-O.OG 

0 

3,14 

1.64 

2.42 

-0.78 

76 

2.68 

2.19 

2.08 

+0.11 

20 

2.81 

1,86 

2.16 

-0.30 

09 

2.60 

2.00 

2.02 

-0.02 

128 

2.67 

1.96 

2.05 

-0.10 

39 

2.60 

1.96 

1.98 

-0.02 

140 

2,72 

2.17 

2.13 

+0.04 

18 

2.61 

1.41 

1.96 

-0.66 

71 

2.71 

1.81 

2,09 

-0.28 

62 

2.66 

2.26 

2,04 

+0.21 

11 

2.76 

2.33 

2.13 

+0.20 

41 

2.93 

1.87 

2,28 

-0.41 

10 

2.87 

1.02 

2.18 

-0.26 

13 

3.09 

1.96 

2.36 

-0,40 

60 

2.67 

1,94 

1.97 

-0.03 

10 

2.46 

1.62 

1.80 

-0.24 

62 

2.70 

1,03 

2.07 

-0.14 

7 

2.74 

1.5D 

2,19 

-0,60 

48 

2.71 

2.02 

2,09 

-0,07 

23 

2.69 

1,02 

2.12 

-0.20 

10 

2.54 

1.82 

1.90 

-0.17 

1 

2.00 

1.18 

1.91 

-0.73 

16 

2.63 

1,91 

1.96 

-0.04 

30 

2.66 

1.97 

2.02 

-0.05 

69 

2.82 

1,06 

2.17 

-0,21 

197 

2.42 

2,04 

1.99 

+0.06 

1 

3.39 

2.04 

2.88 

-0.84 

160 

2.06 

2.22 

2.07 

+0,16 

24 

2.83 

1.68 

2.17 

-0.69 

104 

2.70 

2.39 

1.99 

+0.40 

161 

2.00 

1.07 

2.01 

-0.04 

18 

2.40 

1.67 

1.82 

-0.25 

27 

2.77 

1,87 

2,14 

-0,27 

37 

2.02 

2.18 

2.11 

+0.07 

412 

2.08 

2.26 

2.08 

+0,17 

0 

2.72 

2.39 

2.04 

+0.36 

4 

2.81 

2.37 

2,06 

+0.31 

33 

2.70 

1.80 

2.12 

-0.20 

10 

2.43 

1.77 

1,06 

-0,18 

48 

2.70 

1.87 

2.10 

-0.23 

37 

2.77 

1,06 

2.22 

-0.27 
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Table II. 


Town 

43. ViequcB 

44. Yabucoa 

46. Yauco 

Private Schools 

46. St. Joseph (Aibonito) 

47. San Felipe (Arccibo) 

48. Ac. Bautista (Barranquitas) 

49. Mons. Willingor (Barranquitas) 

60. Santa Rosa (Bayam6n) 

61. Presbyterian (Lajas) 

62. San Luis (I,ajnH) 

63. Inmaculada (Manatl) 

64. Inmaculada (MayugUez) 

66. Santa Teresa (Naranjito) 

66. Col, Poncofio do Varones 

67. Liceo Poncofio 

68. Modern Business CoUceo 

69. La Milagroaa (II. Piedras) 

GO. San Antonio (R. Piedraa) 

01. San Jorge (R. Piedraa) 

02. San Jo8<S (R. Piedraa) 

03. P.R. High School of Commorco 
(Rfo Piedras) 

04. San Josd (San Gcrmdn) 

66. Acad, Catdlica (S. Juan) 

06. La Inmaculada (Santurcc) 

07. Col. Puortorriqueilo (Santurce) 
68. Perpetuo Socorro (Sanlurco) 

60. Sagrndo Corazdn (Santurce) 

70. Blanclic Kellogg (Santurce) 

71. Santa Rita (S. Sebastian) 

72. Holy Rosary (Yabucoa) 

73. Holy Rosary (Yauco) 


(jConlinued) 


No. of 



Pre¬ 


Stu¬ 

H-S 

Grades 

dicted 

DilTer- 

dents 

Index 

in U. 

Grades 

enco 

10 

2.88 

1.66 

1.87 

-0.31 

10 

2.70 

1.08 

2,04 

-0.00 

52 

2.03 

2,07 

2.11 

-0.04 

1 

2.37 

1.30 

1.73 

-0.48 

2 

2.87 

1,08 

2,13 

-0.16 

S 

2.06 

1.79 

2.64 

-0.86 

17 

2,83 

1.05 

2.16 

-0.20 

7 

2.81 

1.62 

2.25 

-0.73 

2 

3.57 

2.03 

2.66 

-0.62 

11 

2.74 

1,65 

2.08 

-0.53 

1 

2.46 

2.00 

1.79 

+0.21 

12 

2.81 

2.66 

2.30 

+0.36 

5 

2.46 

2.10 

2.13 

-0.03 

12 

2.67 

2.23 

2,16 

+0,08 

4 

2.84 

2.71 

2.21 

+0.60 

2 

2.04 

1.83 

1.48 

+0.36 

6 

2.37 

1.79 

1.81 

-0,02 

9 

2.63 

1.60 

1.89 

-0.20 

1 

2.31 

1.71 

1.88 

-0.17 

7 

2.00 

1.64 

1.93 

-0,20 

1 

2.03 

2.00 

1.47 

+1.43 

6 

3.47 

2.61 

2.60 

+0,01 

6 

3.00 

2.18 

2.32 

-0.14 

6 

2.91 

2,22 

2.18 

+0.04 

12 

2.77 

2,56 

2,08 

+0.48 

10 

3.31 

2.30 

2.67 

-0.21 

2 

2.39 

2.52 

1,84 

+0,68 

3 

2.67 

2.34 

1.94 

+0.40 

7 

3.01 

1.87 

2.26 

-0.38 

2 

2.73 

2.12 

2.19 

-0.07 

2 

2.39 

2.28 

2.13 

+0,16 


Students from the smaller high schools do not attain the level 
expected of them. 

This fact is more forcefully presented in Table III where nine 
of the larger and twenty-three of Lhn smaller high schools 

are listed and tabulated on the !)a3is of the wciglited diffcn’ciicos 
between grades actually obtained in collogc and grades predicted. 
In column 1 intervals in terms of ‘difference’ units arc set up. 
The number of students and the actual weighted ‘differences’ are 
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Table III.—Distribution op the Dipferences between 
College Grades Obtained and College Grades Predicted 
FOR Nine Large and Twenty-three Small High Schools 


Intervals 

High School 

N 

Difference 

0.20- 0.29 

Ciales 

11 

0.20 

0,10- 0.19 

San Juan* 

412 

0.17 


Ponce* 

166 

0.15 

0.00- 0.09 

MayagUez* 

197 

0.06 


Caguas* 

149 

0.04 

-0.10—0.01 

Arecibo* 

99 

-0.02 


Cabo Rojo 

39 

-0.02 


JuncoB 

16 

-0.04 


Rio Piedras* 

151 

-0.04 


Yauco 

52 

-0.04 


AdjUntas 

11 

-0.06 


Lares 

36 

-0.05 


Yabucoa 

16 

-0.06 


Humacao* 

43 

-0.07 


Bayam6n* 

138 

-0.10 

-0.20—0.11 

Guayama* 

62 

-0.14 


Jayuya 

10 

-0.17 


Ton Ba]a 

16 

-0.18 


Isabela 

23 

-0.20 

-0.30—0.21 

XJtuado 

48 

-0.23 


Gudnica 

10 

-0.24 


San SebaatiAn 

33 

-0.26 


Comerlo 

16 

-0.26 


Salinas 

27 

-0.27 


Aibonito 

20 

-0.30 

-0.40—0.31 

Vieques 

16 

-0.31 

- 

Corozal 

13 

-0.40 

-0.60—0.41 

Coamo 

41 

-0.41 

-0.60—0.61 

Can6vanas 

18 

-0.65 


Rio Grande 

24 

-0.69 

-0.70—0.61 

Hormigueros 

7 

-0.60 

-0.80—0.71 

Aguada 

6 

-0.78 

* High schools with enrollmenta of 600 or more. 
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given in the last two columns. An asterisk has been placed by 
the name of each high school with a total enrollment of live 
hundred or over. The other twenty-three high schools included 
in the table have enrollments under three hundred. 

It will be noticed that the large high schools arc high in the 
distribution and that the small schools arc low. This means 
that in general the students from the largo high schools made 
indices in the colleges as good as, or better than, those predicted 
for them, but that the students from moat of the small high 
schools actually earned college indices lower than those predicted 
for them on the basis of their high-school grades. Students 
with the same letter grades from small and Urge high schools 
do not liave, it seems, the same degree of training and prepara¬ 
tion for college work. High-school indices from various high 
schools and based on the system of letter grades in use do not 
appear to bo equivalent. 


CONCLUSIONS 

On the basis of an analysis of the data used in this study, 
the following conclusions seem justified: 

1) The high-school academic index is not very reliable as a 
criterion for selecting college students. 

2) There is a positive relationship between high-school and 
college indices bub the degree of correlation is so low that high- 
school indices cannot be used for predicting accurately college 
indices. The errors of estimate are high. 

3) Students applying for admission to college who have the 
same high-school indices do not necessarily possess the same 
degree of training and preparation for college work. 

4) An ‘A' or 'B' grade in one high school is not necessarily 
equivalent to the corresponding *A’ or ‘B’ grade in another high 
school. 

5) Students in general from the Urge high schools (enroll¬ 
ment of five hundred or more) make higher indices in college 
than do students from small high schools (enrollment of three 
hundred or less) with the same high-school indices. 

G) The chances for success in college based on academic record 
are greater for students from the Urge high schools than for 
students from the small high schools with the same high-school 
indices, 
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7) Students with a 'C' average from large high schools make 
on the whole higher grades in college than do ‘B’ students from 
small schools. 

8) The indications are that a grave injustice may bo done 
students from large high schools with a high-school index slightly 
below that required for admission to college. Tiiey may be in 
many instances better prepared for college work than are students 
from small high schools who are admitted to college because they 
have high-school indices a few points higher. 

RECOMMENDATIONS 

The purposes of this study have been realized. The data have 
been collected, systematized, analyzed, and interpreted. Con¬ 
clusions which seem to be w'ell justified by the objective tech¬ 
niques employed have been listed. This paper should not end 
hero, however. Certain suggestions of a constructive nature are 
in order. Those recommendations concern the general problem 
of providing some kind of a screening process whereby those 
selected for college training shall be the individuals from among 
all the applicants for admission who may profit most from college 
work. Such a screening process would result in the admission of 
those students who have the greatest chance of succeeding at 
the college level. The recommendations offered here concern¬ 
ing this general problem may be conveniently classified under 
three main heads: (1) Those designed to improve the reliability 
of high school indices as a criterion for selection (1-6 inclusive); 
(2) those designed to utilize other factors as criteria for college 
entrance (6 and 7); and, finally, (3) those designed Lo extend and 
expand the educational opportunities and facilities of the Island 
above the high-school level (8-10 inclusive). Such extension and 
expansion would tend to change the nature of the selection 
process itself. 

1) Improve instruction in all the public schools of the Island. 
This involves the provisions for more adequate school facilities 
and superior teachers. 

2) Improve instruction, especially in the small high schools in 
order that graduates of these schools may be equally prepared 
(as graduates from large high schools) for college work. 

3) A more uniform and standardized system of assigning school 
marks might bo worked out. 
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4) Consolidate, in so far as is feasible, the small high schools 
of the Island. Distances within the Island arc short and children 
may be readily transported by bus. Such consolidations would 
serve to place the advantages of large high schools within reach 
of all, 

5) The Department of Education and the University of Puerto 
Rico should collaborate in establishing a division of Measure¬ 
ments and Guidance. Such a division would work throughout 
the year in the preparation of tests and other measuring instru¬ 
ments and in the development of techniques for student guidance. 
A comprehensive testing progi*am would be set up for the public 
schools of the entire Island. The test results would be cumu¬ 
lative for each child and would be valuable information which 
might be used for a variety of purposes. Among other things 
the test results could be used as another criterion for admission to 
college and for the purpose of assisting students in choosing the 
courses in college from which they might derive the greatest 
benefit. If this were possible, the money which may be spent in 
giving students instruction in the lines of study for which they 
are not suited, could be used to greater advantage. 

It seems reasonable to assume that the very high mortality 
rate which now exists might be considerably reduced by a good 
guidance program. From the economic point of view wo sliould 
endeavor to hold students at the college level until they finish 
their studies. The per capita expenditure at the college level is 
very great. Moreover, mortality at this level involves indi¬ 
viduals of high achievement and great capacity for learning. 
This in itself presents a problem of paramount importance since 
our country needs people with more training and ability in dif¬ 
ferent fields of education to help in the solution of its social and 
economic problems. 

6) High-school indices should not be used as a sole criterion for 
selection of college students. 

7) Standardized objective tests of various kinds should bo 
utilized as a screening device. Compreliensivc tests dc.signccl to 
measure academic aptitude, reading proficiency (vocalnilaiy and 
comprehension), achievement, and certain aspects of personality 
development would yield infoi'mation of great value for all con¬ 
cerned. Such test results are essential for educational, voca¬ 
tional, and personal guidance. Many such tests are already 
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available and now ones could bo constmeted to meet tbo spocifio 
needs of Puerto ilieana. 

8) Extend and expand the facilities of the University of Puerto 
Rico and all of its branches. The University should be prepared 
to meet the needs of a student body of from 16,000 to 20,000 
within a few youra. As a senior university and graduate school, 
it should be on a par with the beat of tlicin. 

9) A system of public junior colleges offering various types of 
two-yenr terminal courses should bo established. The Island 
might be divided into four or five regions with a public junior 
college located in each and accosaiblo to the high-school graduates 
of tliat region, 

10) Pul>lio buHinc.ss, technical, and vocational schools of 
various kinds to meet the needs of the people of the Island might 
be provided after a study i.s made to determine the needs of tho 
people along ihc'.^e lines. 

Ill eonelusion, it Khoulcl be slated with coiisiderablo emphasis, 
Umt addiliojial roauarcli on this and related problems is sorely 
needed. 
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Educational Psycholo^^y for Teachers 

INTIIODUCTION 

In 1947, the Executive Coiumittcc of the National SocioLy of 
College Tefloherg of Education organised several coininiUoL’.s lo 
study tlie various aspects of teacher e<}ucation. Ono of these 
committees was assigned the task of rccommcnfling the content, 
eequervee, organizaUon and teaching procedure for coursps In 
educational psychology.* This committee hiw made thn‘(? 
reports of progress. Tho first report, made in 1048, conHistecl of 
seven papers outlining tho facts and principles from sevend 
aroaa of psychology as they relate lo cuniculnm dcvoli>pnienl.® 
The second report, mndo in 1949, consisted of five j)aj)(‘rH doiiling 
with tho nature of educational psychology and tlu^ (5onti‘i))nli(jMH 
it has made and can make to the i)roparation of ti-induM's,* I'hn 
third report consists of tho six papers prc.s(?nU;d lurnr. They 
deal with the content of educational psycdioiogy in u limited 
number of areas.* 


‘Tho Choirman of Huh commiltoc in Walter W. (.'mik, lJiiiv(-rHily of 
Minnesota; tho vice-cliaimiati is Win. Clark Trow, UniversiLy of Minhigau; 
tho sponsor for tho Executive Oommillco of tho Souiuty m Frank B. Frconinii 
Cornell University, 

^ "The Psychological Basis of Uio Modern Curriculum," The Journal oj 
Educalional Psi/choJopi/, March J0«18. VoJ. 30, pi>. J2D-UJ0. 

» "Educational Psychology in the l?ducnUonof ToncherH," The Journal of 
Educalional Psycholoyv, May 1940. Yol. 40, pp. 267-204. 

‘Tho six papers ptcaouted here—“Psychology oE (Jroup lh*havi«»r,'’ 
“Wliat Educational Measurement in tho Education of Tciuilicrrt," “Jbnv 
Can Lho Psychology of Dovclopmcnl in Infancy and llclj) 

Toachors," “What Teachers Bhould Know nlnnit Uu! Payoliology of Adolcii- 
conco," “Wliat tho Psychology of ]x>nriiiiig Huh To Conlnliiilo lo llii< 
EducuUou of tho Tcachor" and “The Study «( Imlividual Diffcronci'a in 
tho Erlucation of Teachers'—were presented at the AUiuiik* City 
of tho National Society of Collcgo Teachers of JihlucfiUotJ, Fabniarv ‘>7 
and 28, I960. 






1) PSYCHOLOGY OF GFOUP BEHAVIOR: 
THE CLASS AS A GROUP 


WM. CLARK TROW, ALVIN E. ZANDER, WM. C. MORSE 
and DAVID H. JENKINS 

School of Education, Univcraity of Michigan* 

Social psychology has been experiencing a inarkcd development 
in recent years; and because of the many implications for learn¬ 
ing situations, those tilling the educational fields should be alert 
to the new points of view and new findings which are emerging. 
This statement does not imply that individual educational psy¬ 
chology is to be discarded, but rather that it is now directly 
complemented by the basic socio-psychological concept of the 
group and the consideration of intra-group relationships. As 
long as Bociologista confined their attention largely to such social 
groupings as crowds and mobs, criminals and delinquents, the 
family, and to census groups with racial and nationality ohar- 
aoteristics, the help they could furnish to the classroom teacher 
was relatively slight. But with the development of field theory 
and the study of interaction of individuals in a face-to-face group, 
and more specifically with the coming of the Iowa studies of 
democratic, autocratic and taimz-faire leadership, followed by 
the energetic labors of those in the field of group dynamics, the 
picture has changed. To this has been added the later Freudian 
influence in the mental hygiene movement, its expansion in the 
area of inter-personal relationships, and the exploitation of such 
treatment techniques as those of gi’oup work and play therapy, 
We are forced to ask ourselves whether the school class is a group, 
and, if it is, what this should mean to educational psychologists 
whose task it is to introduce teachers to the principles which 
should aid them in developing the best possible environment for 
learning in their classrooms. 

* Dr. Trow is Professor of Educational Psychology; Dr. Zander is Assist¬ 
ant Professor of Educational Psychology and Program Director of the 
Research Center for Group Dynamics; Dr. Morse is Assistant Profe.ssor of 
Educational Psychology and Director of the University Presh Air Camp; 
and Mr. Jenkins is Lecturer in the School of Education and Picld Consultant 
in Community Adult Education. 
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DEVELOFMENTAIi BACKGROUND 

It sliould te recognized at the outset that educnlionul psy¬ 
chology has from the beginning devoted itself almost oxcliiHivoly 
to modifying the responses of individuals to more or less separate 
stimuli. Tho principles of learning, derived from llio perfonn- 
nneea of laboratory animals and sometimes of children, though 
the results were brought together staiistinnlly, liavo been applied 
bo the individual learnerj and his performaneo has been tested 
by presenting him with ascrics of tasks to perform, and measuring 
his success in performing them. To dc.scribo tho educational 
psychology of the past and tho present in this way is not to 
belittle it. Tremendous improvements have hoen made in 
instructional inaterial.s and methods as a conse(iuoncc of this 
view. Wo can well feel proud of the contributions of our col¬ 
leagues and wish for their continuance, for tlioro is muoii mure 
to be done. After all, individuals are individuals, and tlioy are 
probably hero to stayl 

The single-line, teachcr-pupil relationship, howovor, has olher 
sources than the psychological laboratory, 'riiero seesn to have 
been changing patterns in our educational assumplions u.h to th(i 
most effective and desirable learning HtlunlionK for (lui pupil. At 
one time the tutorial arrangement, the w'.holar ami the Hingle 
student in a face-to-face rclalionKhip, was fell to lx; most nearly 
ideal. And it may be for certain kinds of learning. Tint the 
practical situation in our public sciiools has nol., of (aaiise, per¬ 
mitted tliis kind of teachcr-pupil ratio; so we, tried to make our 
classes of twenty-five or more pvipils into twenty-five »iin\dlane- 
0U8 one-to-one relationships. At any rate wo follow(!d Ihis pat¬ 
tern, in our cla.s.swork, of tonchcr control, aHsigninenl., and clii.ss 
discussion, all dependent on the Icachcr-pupil-lcaeliei-pupil kind 
of interaction. In this tradition wo not only have emphasized 
the importance of the individual pupil of the Kul)jc'el-(!nnteri!fl 
curriculum, but also of individualized iiwlrindion, and tlui <rinid- 
contered school. 

This arrangement tended to he Ktrcngtliniu'd by vii-l-nn of (,lio 
fact that it provided a more direct aysUnu <»( control. Any breuU 
in the line, with consequent Hponlnncuajs int(u’ac.li(m among 
pupils might well moan that the tcaclier hud lost lhat (-ontrol 
which he felt it necessary to maintain. If tluj cla.SH ^\’el•o allowed 
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to become an interacting group, tho behavior oi the pupils would 
presumably not be contributing to the learning goals which the 
teacher had in mind. Thus,' groupincss* implied * bad discipline.' 

Two factors have probably contributed to the movement away 
from this tutorial conception of our clasarooma; tho increoaing 
interest and attention being given to social learning, and tho 
awareness that tho classrooms arc, potentially at least, social 
situations. 'With the acceptance of the broader social goals of 
learning, no longer restricted to scholarly and intellectual activi¬ 
ties alone, dependence on tho tutorial tradition began to lessen, 
and the potentialities of the class as a medium for instruction in 
social learning became clearer. 

The point where modern social psychology can olTer desirable 
additions to the individualiaed approach lies in a recognition of 
the complex nature of what has iu tho past been rather loosely 
referred to as the stimulus situation when this situation is largely 
made up of other persons. Tho exploration of this phenomenon, 
and of the function of perceptual and conceptual processes in 
relation to it, ia the chief contribution of the gestalt psychologists, 
whose point of view the late Kurt Lewin was largely responsible 
for bringing over into tho interaction field of social psychology. 
Teachers have long known that pupils responded to other stimuli 
than the words of wisdom emanating from behind the teacher’s 
desk. But the teacher's tosk was to eliminate such distraction 
BO far ns possible. And ■while this is still often desirable, wc arc 
now interested in these other stimuli also, in the interactions 
of the pupils among themselves and with the teacher. We arc 
asking, what are the implications of viewing the class not merely 
as a number of individuals in the same room, but as a group? 

The exposition of this point of view in education did not 
have to wait for the recent developments in social psychology. 
Although the tone ia definitely authoritarian, beginnings aro 
found, for example in a volume entitled School DisciplineJ by 
Wilham C. Bagley, published in 1917. In this volume Bagloy 
discussed in some detail the problem of what ho called fcho 
“unruly school." He pointed out twin antithetical caueca; 
“harsh and unsympathetic treatment," and “indulgence and 
weakness of control," conditions nob too far removed from 
frustrating autocracy and laissez-faire, respectively. Ho wont 
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on to indicate some of the ‘^difficulties of reconciling the oppos¬ 
ing ideals of individualism and collectiviam.” For trans¬ 
forming the unruly school ho included among other conditions, 
"the importance of the objective attitude, and stimulating group 
responsibility.” 

Likewise many school practices, particularly in the extra¬ 
curricular field, have laid a foundation for group interaction. 
For a number of years group games and fii)orl8 provided for 
codperative as well as for individual effort, and teacher-.spon.sored 
‘activities' of the hobby-club variety tended to promote more 
informal teacher-pupil rclationsliips. The project method, while 
it chiefly emphasized individual performance, also had a place 
for group activities. With the activity program camo the edu¬ 
cational heyday of group participation involving the imitation 
of adult activities in stores, post offices and the like, but largely 
employed a.s a moans for motivating learning and providing prac¬ 
tice in the traditional subjects. 

However, in nearly if not all of these situations, the teacher is 
set off against the class. His view of the class as a kind of unit 
is exemplified when the teacher asks a cjuestion and then says 
"Class,” calling for all to respond more or less in unison. ‘I'lie 
teacher is boss, though at limes lie would tolerate some frocilom 
of action on the part of the children that wonliJ permit jsomo 
release of tensions. Kvon when an 'lUidieiim', Hituation' i.s i)ro- 
vided for pupils to read or rcoitc pu.ssttge.s they liiid U^arned, tho 
samo condition maintains. Similarly In mattovs of student 
deportment, now usually referred lo as eilizcnship, the loaclicr 
is tho interpreter of tho mores of the culture for tho pupil.s, and 
serves as judge, jury, and lord high executioner, all bundled into 
one. 

In some schools, tho system of student government, with a 
student council, ideally shifl.s some of the ro.sponsilnlity to tho 
pupils and permits pupil interaction and group decisions. Sim¬ 
ilarly, in what is veforred lo ns toiiohor-pupil planning tho Lcachor 
forsakes his antithetical position and hecomc'.s an a(!tual groui) 
member in tho rOle of a resource person. It hcMionu'.s (dear that 
Ihoro Im.s been a long period r)f gradual cliung(? in liK'ory wliich 
has boon followed by pvacliee in some sciiools, tlui majority 
however probably trailing far behind. At any rate, it may bo. 
concluded that education is ready for a systomatic ovorliauling 
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of its tlieory and praotioo in dealing with the class aa a group, and 
that it is the proper task of eduoational psychologists to lend the 
way. 


CONCLUSIONS FROM nuSBABCH IN anoUP DYNAMICS 

First, in order to explore some of the possible directions that 
our inquiry might take, let us review briefly a few of the resoaroh 
findings that deal with functioning and group intor- 

relationa in a wide variety of social settings. Althougli teachers 
work with groups and are daily troubled or aided by group phe¬ 
nomena in their classrooms, there has been strildngly little 
research on the dynamics of classroom groups. It is often diffl- 
cult to identify and study the many forces at work in a classroom 
situation, but recent research in group dynamics indicate.? that 
it is possible to develop the necessary theoretical formulations, 
hypotheses, and measuring methods for testing these hypotheses. 
The task remains to identify those areas in which we feel fcho 
presence of group phenomena is most relevant to the classroom 
setting. Wo have much to leoim about the forces involved in the 
relationships among students, and between students and loaohor. 
Since the relationahip between teacher and class-groups, for 
example, is by its very nature changing and flexible, it is impor¬ 
tant that the concepts employed be adequate to deal with the 
dynamics of relationships, involving changing relationships 
among persons, and changing perceptions of the teacher and the 
class, as the members acquire new insights and learnings. 

A number of assertions from recent research in group dynamics 
have both theoretical and practical value for the field of educa¬ 
tional psychology and teaching methods. This list is not 
exhaustive and there will be no attempt to describe the nature 
of the studies from which these data are derived. Many of 
these findings arc from laboratory investigations with groups, but 
a sufficient number of them were obtained in field-experiment 
settings to indicate that work of this nature can readily be done 
in the actual classroom setting, as well as in the la}} 0 i’atory. 
Some of these assertions are wcll-toatcd and validated. Others 
are less well proven. All of them have relevance and promise 
for educational p.syohology. 

1) The attitudes of an individual have their anohorngo in the 
groups to which he belongs. Present evidence makes it apparent 
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that many attitudes can be changed more easily by making 
changes in certain properties of the group than by directly teach¬ 
ing the individuals, as individuals, even in a classroom audience 
Bituation.°'^“ 

2) The conduct and beliefs of pupils is regulated in large 
measure by the small groups within a classroom, such as friend¬ 
ship cliques, and tho cohesive groups of students within a school. 
These groups demand conformity from their members to certain 
group standards, and the more cohesive the group, the greater 
is its power over the member.*'® 

3) In some instanccvS failure to learn may be advantageously 
conceptualized as resistance to change, u.sing resistance hero in 
the same sense as the therapist uses it in his relationships with a 
patient.* For example, the group standards developed by per¬ 
sons who were loarnijig a motor task quite similar to a previously 
perfected one, and who were simply told what they wore to do, 
wore entirely dilTerent from the group standards developed in a 
group in which the learners participated in n discussion and made 
group decisions about the necessity for, and the nature of, the 
new task to be learned. Those who partici])atcd in the discus¬ 
sion learned much more, more rapidly, and witli mucl:k less 
aggression and resentment toward the pei’sons inducing them to 
make tins cliange.*-*’ 

4) When fruKtralions are met, liighly coho.sivc groups main¬ 
tain their effort in inovomenl toward tire gnmji goal much more 
vigorously and ofl'cetivoly Ihuii do groups of low cohesivoness.® 

fl) (iroupH, ospeeinlly those .similar to olas.sroom group.s, can 
bo disrupted into .separate clitpies; or this threat of disruption 
can i)G eliminated, i)y the alloraticm of foret's whieli d(‘tovinino 
the attractiveness of the group for liu; imnnhcuH. (For exami)l(‘, 
helping them to become aware of th(5 stnuiglh of attracLioa they 
have for oacli other, or tlic degree to wbieli mein))ersliij) in llic 
group provides a way to achieve things they value higlily.) 
This con{{iti{m cun bo l)rought about most easily wlien the mem¬ 
bers become aware of the fonu's influencing them, l)ut it can also 
1)0 off(M!t(!d by an outsider, such us a teacher, wlio adroitly helps 

* It kIi(iii)( 1 111! nol(‘(l, hdwi'vi'r, iliiil fiiilure to cluing'' siriy bn cino In Hiicli 
'rcHiHlajuji!.' 'J'lirri* n»«y be >iii set, jjjiHJiJiHfiiflnry niolivatioji, 

inability In iioniiily willi tlio deiiiniids of llic goal or a rational iu)it-ac(H’])Uin<a] 
of a now ])oHiiion. 
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the group to change the impact and strength of these forces 
surrounding and within their group. 

6) The training of persons for effective social action such as 
performance in school or civic service, can lead to greater effec- 
tivenesa of effort by the trainees if they are members of a group 
which is being trained to work as a group, than will result if they 
are merely individuals in an audience situation.*^ 

7) The amount of interaction among students in a class is 
determined in part by group factors. For example, in highly 
cohesive groups arriving at a decision that has general approval, 
the person whoso viewpoint is too different from that of the rest 
will be rejected—that is, ignored. In a less well knit group, in 
which t/he discussion is not directed to a group decision, the 
deviate member is likely to get more comments directed to him 
than the person whose ideas are quite similar to those of the 
rest of the group. “ 

8) When the members see themselves competing for their 
owa individual goals which make cooperative effort impossible, 
there is disruption of the ready communication of ideas, the 
coordination of efforts and the friendliness and pride in one’s 
group which are basic to class harmony and effectiveness. The 
competitive grading system commonly used today is an illustra¬ 
tion in that it creates mututdly exclusive goals among the mem¬ 
bers of a class group. 

9) The group climate or style of group life can have an impor¬ 
tant influence on the member’e personalities. One such style 
of group life can develop hostile, obedient, uncreative, 'gold- 
briokers’; another can produce confused, purposeless, com¬ 
petitive, drifters; and still another can mould cooperative, 
flexible, purposeful, turn-taking, we-spirited persons. The group 
climate that produces such effects is created by the resultant of a 
number of group properties which can bo combined in various 
ways, among which are the leadership style of the teacher or 
that of those who function most as group leaders, the degree of 
oohesiveness, which has already been mentioned, the group- 
rnember-skilla, the suitability of the group process for the task 
in hand, the techniques employed by the teacher to satisfy his 
ego and other needs, and the tension-release patterns used by the 
group.'2-*® 

10) The reasons for the occasional failure of project methods, 
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and other teaching procedures which depend upon effectively 
functioning groups often lie in the ineffective use of group 
problem-solving methods, or in tho unskillful handling of group 
procedures. Groups can help themselves to mature and improve 
thoir ability as a learning or producing team by diagnosing their 
own failures and planning ways of repairing their own dcficicncics- 
Students of group development have devoted much attention to 
methods of group diagnosis, ways of presenting the findings 
to a group, and methods for alleviating ii group’s procedural 
difficulties.® 

11) Certain forms of classroom behavior may be recognized 
as mechanisms developed for relieving tensions somewhat similar 
to those employed by an individual in relieving his tensions. 
For example, they employ patterns of group behavior which 
help avoid difficult tasks or unpleasant siluttlions. These mech¬ 
anisms are often difficult to identify since they may either bo 
wrongly perceived by the teacher as signs that ilio group is 
keeping busy, or they may bo ncceplcd a» tho usual VvoublcH 
one gets into by tho use of cominitlcc methods. 

12) Difficulties in tho transfer of verbal learning to social 
behavior, can often be overcome by tlio use of that form of 
rdlo-playing referred to as reality practice?, in whi(?li (he jiar- 
ticipants try-out the behavior they arc cxp<?ctcd to use in a situ¬ 
ation from which all threat has been r<;moved. Inhibition 
blindnesses, or fcar.s of ‘learning’ certain content, or bclinving in 
unaccustomed ways can bo removed by the use of a ‘cultural- 
island,’ a situation wlicrc new group standards are generated 
while away from the source of the inhibilions. This procedure 
is effectively used in excursions, conforonccs, summer camps, and 
other group activities in which the person is under Llie pre.ssurG 
of group standards that arc different from those at home, and so 
he dares to adopt forms of behavior which might be quite dc.sir- 
able for him, but which he might hesitate to tiy out in his uccuh- 
tomed environment for fear of adverse criticism.’ 

Thus wo can safely accept the view that group phonamcno. 
definitely affect tho progro.sH of l(?arning, an well n.s tho kind of 
learning that takes place. Tho oduetilional Kigniliean(?r? of lliiu 
view derives from the fact that the pupil’s aUitudes as well as 
his behavior patterns arc modifiable. Increased motivnlion in 
participating in tho classroom activities, and consequently in 
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learning, derives from several dilferent potential sources in a 
group atmosphere where good mental hygiene prevails. 

Three such potential sources of increased motivation will be 
considered. The first of these sources lies in method of goal 
delerminalion —the extent to which the goals of the class are 
determined by the entire group including both pupils and teach¬ 
ers, in a truly co-participant sense. When this procedure is 
followed, the child will fool that he has some control over his own 
destiny and, therefore, is able to accept the group goals which he 
helped select as being his own personal goals. They are things 
which he himself wants to do and, therefore, he is more likely 
to follow through on them. The absence of such codetermined 
objectives does not mean the absence of group standards, but 
some of these standards are not likely to be the ones which tho 
teacher would choose, or the ones which beat promote learning. 
Such group standards as the ‘gentlemen’s mark’ of C, and the 
group rejection of the student who is too ‘eager,’ are familiar to 
all. Thus group standards in a classroom may inhibit good learn¬ 
ing as well as accelerate it. 

The second source of increased motivation lies in the extent 
to which the teachers and the pupils build a swpyorlive atmosphere 
in the classroom, one which helps each child to realize that lie is 
an accepted group member. When this condition maintains, 
each child has his own ‘area of freedom,' within which ho is 
free to make his own decisions. This area can often be much 
wider than is ordinarily supposed by teachers who arc constantly 
making pupils’ decisions for them. Although the group may not 
approve of everything a pupil docs, it still accepts him as a 
person. In this kind of an atmosphere the child is able to develop 
a greater feeling of security with his fellows. In addition—and 
this is the important contribution to learning—he i.s likely to feel 
freed from personal threat and criticism and, therefore, more 
willing to go ahead and try new things without fear, realizing 
that if he fails ho Avill not be rejected either by the class or by the 
teacher. Thus failure can be a very positive learning experience 
because, once the emotional throat is removed, the child can loolc 
at his abilities and limitations far move objectively and with 
greater awareness of what next steps arc required for liis learning. 
It would seem that little learning can occur if the child is denied 
positive opportunities to make errow. 
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A third potential source of increased motivation lies in the 
extent to which the various members of the class are accepted aa 
participating memhers. When they are so accepted, each can 
benefit from the knowledge, skills, and abilities of all the other 
members. They are no longer dependent primarily or solely on 
the teacher for all information and guidance. Besides offering 
the possibility of the development of broader understandings, 
this gives to each i)upil the opportunity to be a contributor to the 
group, and the classroom becomes, then, a situation for mutual 
exchange, for mutual sharing. Ilesoarcli is beginning to sliow 
the increased productivity of groups wdiich liavo this cooperative 
pattern of relationship.^ Goal delcrmination by the group, a 
supportive atmosphere, and a participating membership, then 
constitute three conditions of group organization of great olTcc- 
tiveness in developing motivation which contribute to the promo¬ 
tion of effective learning. 

'HIE Ii6lES of a. TEACIIIOn 

What can the teacher do to develop and maintain the.se condi¬ 
tions conducive to learning? There arc tlirce fundamental r61ca 
which cover the things a teacher doc.s. Actually tiieH(i anj not 
discrete parts of the teacher's job, but they do carry (piilc differ¬ 
ent implications. The rAlcs that will bo (lisc.uK.se<l are tljo fol¬ 
lowing: (1) tho instructional r61e, (2) the n'ile of th(i deinoeratic 
strategist, and (3) the rOlc of tluj Lherai)iHt. Following tills, wo 
will ask how the icaclicr selecL.s the projicr rfile., and how the 
actual operation of this r61c can be evaluated. 

First, the insLruclion r6lc. It is oljviou.s that tlie concept of 
what a teacher sliould do has changed over tlu; yeans. To the 
Hoosier sclioolmaatei' the matter was (luite lie was the 

drill sergeant. The cadence of recitation wns akin to tlie sound 
of marching feet. As master of the drill, lie called the sLeps. 
This teacher also hold tho role of academic authority; not only 
did he choose the school exi)erion(!e.s, l)ul he was ul.so r('v<!r(‘d 
for his groat storuhou.se of infornuUion. Ilis very person was 
the embodiment of learning, and lie was eaU'gorieally right. 
This fundamental instructional rOle lias uu'llowial with the 
years. Now tho ioaehor does not always huvc! to know. Ih* 
operates as an adult with superior learning to bo sure, IniL serves 
more us a resource person explaining, tolling, and clemonstrating. 
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His drill-master’s uniform has been exchanged for the Socratio 
garb, for his instruction is more concerned with fostering the 
students' power to think and reason. This major ‘informational 
r61e' of the teacher is often discussed and is perhaps quite well 
understood. But it should be clear that this r61e itself is not 
exclusively the property of the teacher. At times, especially as 
the content of the course falls within, the experience of the stu¬ 
dents, the class members share or take over the instructional 
r6Ie. As we come to understand more about the dynamics of 
the classroom, we realize that the way in which this rdle is han¬ 
dled by the teacher has important effects on the total learning 
situation. 

A second major r61e which the teacher must play is that of 
democratie strategist. This has been discussed by other writers 
under the heading of "group formation.” With the goal of 
pupil participation the teacher must provide the occasion for the 
introduction of processes to facilitate teacher-pupil planning. 
To play this r61e successfully two things are required: a high 
regard for democratic values, and their implications, and a high 
level of psychological insight into group factors and individual 
personality. In the r61e of a democratic strategist, the teacher 
helps the group utilize various methods of progress evaluation, 
and the information about their progress which tlioy secure. 
He further helps them see and clarify their accomplishments, 
blocks, and failures, os well as the values in democratic group 
action. Thus the task is more than that of being merely an 
exponent of democratic education This r6le becomes one of 
activating democratic processes by helping the class to experience 
democratic goals and relationships in the design of their everyday 
classroom experiences. 

Understanding the dynamic forces which are affecting the 
class as a group and those which the techniques bring into play 
makes possible a contribution to democratic learning because 
our democratic ethics have established the educational goals and 
values. Techniques are selected in terms of their potentiality 
for contributing to the democratic goals of the group at the par¬ 
ticular time. It should be pointed out that on the basis of a 
different set of ethics for the same conditions in a group, different 
techniques would be selected in order to aohiove the goals deter¬ 
mined by these differing ethics. However, since it is a contribu- 
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tion toward democratic learning that is desired, it is essential 
that teachers become as skilled as possible in understanding and 
working with their classroom groups. For a lack of such skill 
is likely to result in conditions which are quite the opposite of 
democratic, even though democratic tcclmiqucs were supposedly 
being used. Democratic techniques do not exist per sc; a tech¬ 
nique is democratic only to the extent that it serves ns a means to 
help the group achieve its democratic goals at a particular time. 
For example, the democratic technique of voting luis ))ecn used 
as a very effective method of imposing some small minority 
opinion on the group. 

A third important rdle of the teacher can bo subsumed under 
the title of therapi.sfc—a combination of clinician and group 
worker. Lest somcono remonstrate at this obligation, lot him 
be reminded that, willingly or not, every teacher }>lays this rdlo. 
Sometimes it is somewhat separate from other functions, Init 
more often it is embedded in the classroom life while other func¬ 
tions predominate. No teacher avoids being a gronj> worker, 
althougli some are more successful than others and some do crude 
jobs to be sure. The rdio of therapist implies group inanagomont 
to the end of helping all of tho chUdven toward indiviiUml and 
social adjustment. This moans a degree of pornuHsivniUiSH, tlio 
cstablislimont of rapport with cac.li child, and Urn conduct of tlio 
work without tho teacher’s ego becoming involved. Such mas¬ 
terful, objective, ‘impersonal’ hninun rclaUonsliipH are hard to 
come by. No one person is able to moot tho (lifloronlial needs of 
thirty-five or more children and serve ns a cusliioii to softon the 
blows of harsh reality dealt out by the cluld'H poor culture. Tint 
one tries. To do this tho teacher must so act as to bo tho 
implicit embodiment of an acceptalfic code of Ix'liavior. Time 
and time again the mores of mental hygiene are illiiatralcd as tho 
teacher relates to the children, to their feelings and to tlieir 
problems. 

It is through the supportive atino.spherc previously discussed 
that tho leaohei's’ therapeutic work is curricui on. In a conflict 
situation pupils may come to the teacher as a jinlge or decision 
maker. Tho caso need not l>o hiimUed arbitrarily, but it must l)o 
handled. ToacherH can never bo neutrals but are continually 
intorproting 'the law’ aa it applies in individual cn.sc.s. In the 
therapist r61e, the teacher shares insights concerning human 
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behavior, helps to get at causes of conflict and to find methods of 
resolving it. Sometimes the teacher serves this end by just being 
a friend, or he may provide, or himself be, an example with whom 
the child can identify in the Freudian sense. At any rate, the 
teacher must be an expert in human relations, understanding 
both the group and the individual. 

In general teachers play this rdlc least adequately of all. 
They tend toward being moralists, policemen, or punitive agents 
expecting good character to be developed by decree. While we 
have much to learn in applying the therapist r61e to the teacher, 
we already understand enough to know that such a playing of the 
r61e spells failure. The reason for such failure may often be 
that the teacher, liaviag personal needs, tends to exploit the 
situation to satisfy these needs. We have in mind tho need to 
be loved, the desire to avoid conflict, or pressures from latent 
hostility as examples. A very common attitude is the desire 
for dependency, where the teacher is happy if the students 
remain, attached and dependent. Redl*** lias written a very 
interesting paper approaching this from a slightly different angle 
in which he shows how teachers tend to orient tlic whole atmos¬ 
phere so that it plays into a masochistic or sadistic syndrome, to 
take only two examples. This is a complicated study in depth 
psychology, fraught with controversy. But it is not without 
point to US. 


SITUATION Ain> CHOICE OP Ii6lE 

From the point of view we have been discussing, it will be seen 
that there is no single complex of r6Ies a teacher plays. The 
different legitimate objectives of a classroom demand different 
emphases. Certainly groups of children differ in their leader¬ 
ship qualities, and other individual and group factors need to be 
studied and understood. The question the teacher would then 
ask is: “What technique will contribute most effectively, in 
terms of the dynamics of my class at this time, to tho goals and 
values which are held by the class (or myself, depending on who 
determines tho goals)?” Two things arc needed in selecting the 
techniques: (1) a knowledge of the dynamics of the technique 
itself, and (2) a knowledge of the goals and values of the group. 

Knowledge about groups will help materially in gaining an 
understanding of the dynamics of a particular technique, and of 
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the kinds of forces in the group which it brings into play in a 
positive (or negative) manner under specified conditions. To 
know these dynamics is important. Otherwise the teacher may 
fall into the trap of thinking that certain tcchniciucs are ‘good’ 
per se, forgetting that a technique will contribute to the group 
only as it is able to draw on the positive forces present in the 
group at the time. If the condition of the group is different at a 
particular timoj the ‘good' tGchiiique may bring out all that is 
‘bad’ in the group, causing him to wonder why it didn’t work, or 
to blame the group for ‘not cooperating.’ 

SOME TYPICAL CUES FOR k6lE CHANGES 

How is it possible to dcLcrmino which rfllc to play at a par¬ 
ticular time? Wliat are the characteristics of a group which will 
serve as cues for shifting r61es? One such cue is group 'apathy.' 
If the group is lethargic and pa.ssive, ono must start scurchiug 
for reasons. Is it the cour.se content? The teaching methods? 
A general atmosphere of repression? Children who do not 
become boisterous at times are living under the control of teach¬ 
ers who are misers of freedom. 

Another cue is to be found in the rapidity of ‘spread of dis¬ 
order.’ In a group with adcciuaLe morale and goal involvement, 
disturbances do nob spread easily. If ono eliild upsets tlio riiom, 
individual work with that child is, of course, indicated, But 
more important is the .signal it gives about tlie group condition. 
If a 'bad actor' is a source of rapid contagion, the bond of com¬ 
mon purpose must be weak indeed. Tlii.s (tondition may bo 
caused by such a simple thing as the need for a chang<! of activity 
due to a requirement for overlong aUoniion to a Hpccific task. 
It may be a tension for muscle discharge, or it ina}'^ go fur beyond 
this to a fundamental dissatisfaction with the toachci’ boliavior. 

Other cues for further diagno.sis and rt'ilo niodiliciition inoludo 
the presence of isolates, cliques, scaiicgoaling, cxelusivcncHS, 
extreme competitivenesa, and the like. Ilow luueh do Unu'hers 
know about diagnosing those things? Indeed, Innv mueli help 
can educational psychologists give? Once the teacher really 
understands the situation and appvceiate.s its d<icpev aspects, the 
r61o complex to meet the situation can usually be found. The 
task of the educational psychologist is to sec that teachers 
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are so trained that they will understand the dynamics of that 
situation. 

Understanding more about the dynamics of groups helps the 
teacher in a variety of ways toward increasing hia effectiveness 
in the r61es that are appropriate in different situations. As more 
is learned about the theory and research on groups, new ways of 
thinking about the classroom situation will at first be gainedi 
ways which may have been ovcidooked before. The impor¬ 
tance of effective communication will come to be recognized in 
giving instructions and in expressing ideas. The relationships 
between the various pupils hi the class will he studied, how they 
feel about each other, and the leader-group relationships, and 
gradually the teacher will become aware of his own behavior in 
the class and the kinds of effect it has on the pupils. 

Of course, it is not easy to take one’s knowledge into the class¬ 
room and become immediately aware of these complex interrela¬ 
tionships. Often it takes considerable training in observation 
and experience to be able to see, especially at the time it is hap¬ 
pening, what is occurring in the group and what its causal rela¬ 
tionships and potential effects are. The transition from 'book 
learning' to 'observation skill’ ia a difficult one to make, but it 
must be made if knowledge about groups is to contribute to teach¬ 
ing effectiveness. 

BVAt.'OATION 

"How does one know one has offeotively employed the correct 
r61e? Were the results in the true psychological sense, those 
which were described? Was there progress by the individual or 
the class in the direction of the goals which had been established, 
and was this progress os great as it might have been if some other 
teacher r61e had beon used, or if this present r61e had been carried 
through more effectively? And were the dynamics of group 
relationships improved as a result of this particular r61e? Is 
the class in the ‘healthier’ condition and more ready to take for¬ 
ward steps toward whatever new goals may bo established, or 
have they achieved some of their important goals at great cost 
to themselves and to their interrelations in the group? 

Information about these questions can come from different 
sources. The teacher, by employing the same sensitivity and 
observational skill used in individual diagnosis of pupil difficulties 
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will become accustomed to diagnosing the group. An examina¬ 
tion of the condition of the group will be an examination, at 
least in part, of the way in which the role previously employed 
affected the group and their response to it. Diagnosis and 
evaluation, then, go hand-in-hand ns a continuing process for 
the teacher. Evaluation of a previous step, in a large measure, 
provides the cues for the next step, nud for tJio clroico of the role 
to be employed. 

Of course, the teacher is not the only source of evaluation data 
in the classroom. To overlook the students' contributions is to 
disregard not only a most important source of information, but 
it is to deny the students the opportunity of evaluating their 
experience in the class which is the basis for making decisions to 
improve themselves as individuals and as class members for futuro 
work. It is not an easy task, obviously, to carry through an 
effective evaluation as a group, but the proco.ss may bo a most 
valuable educational experience for all.*® 

A third source of'evaluation data depends on tlio availability 
of outside persons who could be called into the classroom os 
observers. Someone who is not liims(jlf involved in the group 
is often able to note many important situations wliicli tho person 
who is trying to carry through an effective teaching job almost 
necessarily overlooks. The outside observer—wliotbcr ho l>o a 
supervisor, principal, fellow lonelier, oi- trained (ilini(!iiiii--c!an 
note these situations. And to tho extent that Im Iiuh the iicrsonal 
skill in his relationships with those individualH to di.scuHH his 
observations with tho teaolicr freely and uccoptingly, lie can bo 
of service in increasing the tcaohor's own skill in the classroom. 
Ho may also take the next step and open his insiglit.s to the group 
as a whole, helping them to see and comprehend more fully tho 
processes of group interaction. 
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2) WHAT EDUCATIONAL MEASUREMENT 
. IN THE EDUCATION OE TEACHERS? 

WALTER W. COOK 
Univoraity of Minnesota 

In determining wliat educational measurement has to con¬ 
tribute to the education of teachers we shall attempt to answer 
three questions: (1) How can measurement improve the classroom 
learning situation? (2) What arc some of the most important 
knowledges, skills, attitudes, and abilities which the teacher 
needs with reference to measurement? and (3) How can these 
needs be most effectively met in the teacher education program? 

HOW MBASUEBMENT AIDS IN IMPROVING THE CLASSROOM LEARN¬ 
ING SITUATION 

The most important characteristic of a favorable learning situ¬ 
ation is a strong ego-involved drive on the part of the learner to 
acquire the various socially approved behavior patterns wiLli 
winch the school is concerned. To assume that learning activi¬ 
ties can be self-sustaining and ends in thctn.solves is pcrlinps one 
of the most common errors in educational thinking. Such activi¬ 
ties arc in reality the means of acquiring an incrcaying realization 
of social status, prestige, and other basic ego satisfactions. Wliat 
the learner really afcrivca for is social position with security, 
prestige status with his peers, favorable attention, and recogni¬ 
tion of his special virtues, abilities, and aecompliKlimeids. Ho 
also wants success in what ho undertakes, somo ad venture, and a 
progressive broadening of signidcanlly related and meaningful 
new experiences. A good school or a good learning situation is 
one in which these fundamental cravings of the individual arc 
satisfied through educative experiences. 

The eight-year-old who gels up at an early hour to practice 
reading a story he has volunteered to rend to the class, the alge¬ 
bra student who burns the midnight oil with th(5 really tough 
problems, tlie extra hours spent on a special report, tiuj football 
squad at its gruelling practice, and the l)oy who secures a paper 
route to earn money to buy a trumpet, to lake Ich.sohh for six 
months, to get to play in tho band and wear a flashy uniform, are 
all examples of the social prestige factor in the learning situation. 
Tho problem then is to moke learning highly satisfying in this 
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sense. It should not be preparation for prestige getting—it 
should be prestige getting. 

Certain elements of the classroom situation which arc related 
to the prestige goal and which may be improved through the 
proper use of measurement are: 

1) Clflssificntjoii and grouping. Tlio first consideration is that 
students should bo classified in such a way that no embarrass¬ 
ment or stigma is attached. The student should bo among his 
recognized peers if status in the group is to be sought. This 
primary grouping must be largely in terms of overall physical 
and social development. The secondaiy grouping must be in 
terms of common achievements and learning needs. Group 
unity and cohe.sivcness nre essential. These result from having 
common goals, common understandings, common efforts, com¬ 
mon interests, common difficulties and common achievements. 

2) The individual student should be placed in reading materials 
and problems comfortable for his level of ability. Success and 
the means of attaining it must be emphasized. An optimistic 
and encouraging atmosphere should prevail in the classroom, 

3) Individual instruction with recognition of specific accom¬ 
plishments and attention to specific deficiencies should be 
possible. 

4) Objective measures of achievement and progress are effec¬ 
tive stimulants to further efforts. 

5) The student should have a clear conception of what he is 
attempting to accomplish. The objectives must be clear. Ho 
should also know what his specific errors and misunderstandings 
are. The moans of self-appraisal and identification of needs 
should be provided. Shortcomings should always be consid¬ 
ered as something to overcome, not ridiculed. 

6) The teacher should have an economical method of determin¬ 
ing the interests, problems, aptitudes, abilities, physical condi¬ 
tion, social adjustment and self-adjustmcnt of each student. 

7) The goals of each child should tax his abilities and yet be 
reasonable for him. There should not be competition among 
students unequal in ability. 

Wn/iT TUB TBA-GIIEa NEEDS TO KNOW ABOUT MBASUUEMENT 

Instruments of cducationtd measurement are simply the 
means by which the quantitative aspects of human behavior are 
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observed with greater accuracy and economy of time. To the 
extent that such instruments are valid and conform to the 
principles of quantitative logic it becomes possible to know with 
greater exactness the relationship among the various aspects of 
educational procedure the aptitude of learners, and changes in 
human behavior. The purpose of this being to make possible 
more accurate prediction and control in the educational process. 

To use measurement effectively in improving the learning 
situation the teacher needs to know not only how to apply the 
instruments and read the scores meaningfully, but also how to 
modify the learning situation in terms of what the scores reveal. 
The teacher must have a bowing acquaintance with the fund of 
research based on measurement and commonly designated as 
individual differences, child development, learning theory, mental 
hygiene, and group dynamics. Mcnaurement is simply a tool 
to increase the accuracy and efficiency of observation; its value 
depends upon the insights of the user. 

The following itemization of what a teacher noG<lH to know in 
order to use measurement effectively is suggestive, Init certainly 
not exhaustive. The toaoher needs to know: 

1) What standardized tests arc most commonly used in tlic 
subjects and at the grade levels ho proposes to tcjach. He 
should have taken the tests, administered the tc.st.s, scored, and 
interpreted them. 

2) How to compute percentile ranks and standard scores and 
interpret tlicm with reference to equal unit.s on the base line of 
the normal frequency curve. IIow to convert a standard score 
to a percentile rank. 

3) How to compute age scores, grade scoi'cs and intolligcnco 
quotients. The advantages and disadvantages of each tyi)o of 
score. 

4) How to compute, interpret, and use properly the following 
statistics: median, mean, standard deviation, prodiict moment 
coefficient of correlation and simple tests of significance. (The 
oompufcfttion of these statistic.^ frcjin a fio(ju<;ncy (llstribution is 
not necGs.sary and tends to inhibit imdersLanding. (Computa¬ 
tions should be kept simple with cmpha.si.s on undcirstanding.) 

5) How to compute and interpret cocjllicicnts of rclial)ility 
and validity with undcrstimding of the /aolors Aviiicli infhionco 
each. 
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6) How to interpret a test score with reference to the standard 
error of measurement. 

7) How to construct an objective test with attention to the 
following details: (a) stating objectives in terms of changes in 
behavior; (b) organizing subject matter through which these 
objectives are attained; (c) the advantages and disadvantages 
of the various types of objective items; (d) the proper sampling 
of objectives and subject matter; (c) the answer sheet; and (f) 
the scoring key. 

8) How to compute by at least one simple method the per 
cent accuracy and discriminating power of test items; what the 
relationship of these two measures are to the form of tho distri¬ 
bution of test scores; and their influence on reliability and 
validity. 

9) How to construct individual and class educational profiles 
to show development over a period of years. 

10) How to prepare for and conduct an interview with a par¬ 
ent, analyzing the acliievemenl and behavior characteristics of a 
pupil. What one should learn from a parent in such an interview. 

11) What to anticipate when a battery of tests is administered 
to a class. iFor examplo, that the four-standard-deviation-rango 
of ability and achievement at tho firal-grade level is approxi¬ 
mately four years, at the sixth-grade level it is eight years, and 
at the ‘high-school level it is approximately ton years. The 
teacher should know a simple method of determining this for any 
grade level. He should also know that the typical pupil will 
show approximately eighty per cent as much variability in his 
various traits as the class does in the various abilities. 

12) That age groups show no more variability than grade 
groups even when a considerable amount of retardation is prac¬ 
ticed. ror example, if the beginning seventh grade were to be 
made up of all the twelve-year olds in the school the variability 
of this group would not be significantly greater than tho seventh 
grade which exists with its typical range of about five years in 
chronological age. 

13) That a high rate of failure simply reduces tlie general 
intellectual and achievement levels of a school through the hoard¬ 
ing of slow learning pupils. 

14) That where pupils are stimulated to maximum develop¬ 
ment in a given area the best predictor of growth in that area is 



What Educational Mcasuremenlf 


343 


past achievement, not intelligence. For example, the best pre¬ 
dictor of achievement in arithmetic is past achievement in 
arithmetic, not the intelligence test score. 

15) That pupils should be grouped differently for instruction 
in each learning area. For example, not only will the grouping 
for reading be different from that for arithmetic, but the group¬ 
ing for basic reading instruction will differ from the grouping for 
reading in connection with unit activities and that still different 
bases for grouping will prevail in the remedial reading and free 
reading programs. 

16) That not all the important aspects of child development 
are now measurablo and hence other means must be used to asses,g 
achievement in many areas. 

17) That some learning is of a highly temporary nature while 
other learning is relatively permanent. The testa used should 
emphasize the permanent learnings. 

18) That readiness tests, diagnostic tests, and to some o.xicnt 
achievement tests are based on a systematic approach to errors 
and learning difficulties, hence by studying these tests the teacher 
will develop his ability to observe significant behavior and 
become less dependent upon such tests. 

19) That the use of moasuromont makes posHible the cliild 
dovelopment approacli to education as opijo-sod to the suhjoct- 
matter-to-bc-covorod approach. 

20) That because of the varial)ility of clasHroom groups, Liio 
grade levels at which certain knowlntlgo, nkillH, and abilities 
should be learned cannot bo dotorminod with any diigroo of 
specificity. 

21) That since life outside the school rcoognize.s Jind I’cwards 
a great variety of aptitudes and combinalion.s of aptitudes, the 
school should do the same. 

22) I-Iow to apply at least one readability formula to reading 
materials, 

23) That determining pupil status in a given tlcvclopinon- 
tal area and adjusting instruction to statu.s is good teaching 
procedure. 

24) That moasuroment ns a motivating condition luis threo 
functions in the laiiruing proces.s: (1) The onorgis'.ing function, to 
increase the general level of activity and effort. (2) Tlu; direc¬ 
tive function, to direct the aoLivity of the learner into desirublo 
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cliannels. (3) The selective function, to determine the responses 
which will be fixated and the responses which will bo eliminated. 

25) That the major funolions of a comprehensive testing 
program are: 

(a) To direct curriculum emphasis by: (1) Focuaing attention 
on as many of the important ultimate objectives of education 
as possible. (2) Clariricntion of educational objcclivea to teach¬ 
ers and pupils, (3) Determining elements of strength and weak¬ 
ness in the insLriictionai program of the school. (4) Discovering 
inadequacies in curriculum content and organization. 

(b) To provide for educational guidance of pupils by: (1) Pro¬ 
viding a basis for predicting individual pupil achievements in 
each learning area. (2) Serving as a basis for the prolimiiiai'y 
grouping of pupils in each learning area. (3) Discovering special 
aptitudes and disabilities. (4) Determining the (lifTiGulty of 
material a pupil can rend with profit. (5) DeLormining the 
level of problem-solving ability in. various areas. 

(c) To stimulate the learning activilics of pupils by: (1) Enabling 
pupils to think of their achievement in objective berms. (2) 
Giving pupils satisfaction for the progress tlioy make, rather 
than for the relative level of achievement they attain. (3) 
Enabling pupils to compete with their past performance record. 
(4) Measuring achievement objectively in terma of accepted 
educational staudayds, rather than, only by the subjective 
appraisal of teachers. 

TEACHING EUUOATIONAIi MEASUREMENT 

To achieve the objectives outlined above will require no less 
than the equivalent of five quarter hours of college work, three 
hours pec week of lectures and readings, paralleling four hours of 
laboratory work. The eourse should be one of the first if not 
the first in the professional curriculum because: (1) It is syste¬ 
matic, has definite content, and requires strenuous intellectual 
effort. (2) It provides readiness for professional study and the 
reading of educational literature. (3) It introduces the student 
to the school and individual pupils in a concrete meaningful way. 
(4) It avoids the stigma commonly attached to beginning courses 
in education resulting from their higlily generalized laboring of 
the obvious and the inconsequential. 

Considerable individualization of instruction in measurement 
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is desirable. The varying capacities of students, fields of special¬ 
ization, levels at which teaching is planned, interests and readi¬ 
ness of students require that there will bo some differentiation in 
readings and laboi'atoiy xi'ork. 

The students should be placed in contact Avith elementary- or 
high-school pupils as early ns possible. Each teacher candidate 
should have practice in administering, scoring, interprotiug, 
recording and reporting various moasui'emonts for at least one 
pupil. By bringing together these individual studies the prob¬ 
lems of both the individual pupil and the entire class can become 
matters of study and discu.ssion. Tlie purposes of measurement 
and statistics in the work of a teacher-arc made obvious from the 
beginning through such procedures. 

Students should have experiences in reading educational litera¬ 
ture Avhich involves quantitative and statistical interpretation. 
The professional sequence in teacher education should make 
demands upon the student for his knowledge of quantitative, 
objective, and measurement concepts in reporting observations 
in student-teaoliing, in reading assignments, and in understand¬ 
ing lectures. 

The students should have oxporionco in constructing various 
types of teaohor-mado tests, '.fho administration of sucli tests 
may of necessity bo dolayod until tho period of fitudent-toaeijing. 
EmpJwsis should bo piaood on tho ohjootivos to ho /noiiourod and 
the refinement of testa on the basis of data (loUecLcd through thoir 
administration. 

Much of the detailed knowledge necessary for measuring readi¬ 
ness or malcing a diagnosis of needs in reading, arithmetic, 
English, etc. will of necessity bo taken up wlien tlie student 
studies method in these specific areas. 

The nature of the course can bo most concisely described liy 
outlining in parallel columns the approximate sequence of topics 
in the lecture and laboratory periods. 


Ledturee and Itondings 
3 liours por woolc 

1) Thfl imUirn and oxtoiit of indi¬ 

vidual diffevonenfl in Lho aoliool. 

2) Trait diffcronccB, niul tho liinila- 

tions of ovor-all hoinogoncous 
grouping. 


Laboratory work, IVobloins and 
ObHorvatioiiH, <1 liovira p<‘r wcu'k 

1) OliHorviiiK till! (iilniinistration of 

grou]) lo.slH. 

2) OliHorving tlio iidiuinistralioii of 

individual monlal loats, 

3) TJio scoring of a tost battery. 
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Lectures and Readings 
& hours per ■week 

3) The cfTccts of various poUcica of 

promotion and grouping. 

4) Teaching objectives as rclnlecl to 

temporary learning, permanent 
learning, and hoinogeneity of 
achievement. 

C) Adininistrntivo procedures neces¬ 
sary for incoling the educational 
needs of individual children. 

6) Curriculum policies necessary for 

mooting tho educational ncoils 
of individual children., 

7) Educational objectives ns related 

to measurement procedure. 

8) Tho logical aspects of educational 

measurement, Whnt measure¬ 
ment is, how it differs from 
enumeration, evaluation, judg¬ 
ment and testing. Derived 
scores, validity, reliability, sam¬ 
pling anti objectivity. 

0) Percentile scores. 

10) Standard scores. 

11) Age scores. 

12) Grade acorca. 

13) Intelligence quotient. 

14) Tho meaning of a coefficient of 
correlation. 

16) The meaning and measuring of 
test validity. 

16) Tho meaning and measuring of 
test reliability. 

17) Factors "which influence test 
validity and reliability, 

18) The procedure in constructing 
an objective test, Statementof 
objectives. Outline of subject 
matter. Advantages and dis¬ 
advantages of various types of 
items. Tho niiawor sheet and 
scoring key. 

10) Determining item difficulty. 

20) Dotormining cliacriminating 
power of tost items. 

21) The proper sclecLion. of llomB 


Laboratory work, Problems and 
Observations, 4 hours per week 

4) Making educational profiloa of 
individual pupils and studying 
growth records. 

6) Studying tho educational needs 

of a pupil by obaorving samples 
of work, permanent records, and 
observation of behavior. 

0) Observing classes in which pupils 
have been grouped in terms of 
learning needs. Observing ma¬ 
terials vised, problems, proce¬ 
dures, and objectives. 

7) Computation of percentile scores. 

(Using actual test scores) 

8) Computation of the mean. 

0) Computation of the standard de¬ 
viation. 

10) Computation of standard scores. 

11) Problems involving tho conver¬ 
sion of a standard scoro to a 
pereonlilo rank. 

12) The normal probability curve, 

13) Ojoiputation of the product 
moment coofficient of correla¬ 
tion. 

14) Predicting achiovomont in read¬ 
ing from reading readiness 
Bcores. (This for primary 
teachers, other problems of pre¬ 
diction for otlior teachers.) 

15) Tho standard error of c.stiinato. 

10) Tests of significanco, 

17) Constructing an objective test, 
stating objcctivoa, outlining sub¬ 
ject matter, building items, 
making an answer sheet and 
scoring koy. 

18) Administering tho test when 
possibio, 

10) Computing item difllculLica. 

20) Computing an index of discrimi¬ 
nation. 

21) Rovising the lost in terms of 
item difficulty and disoriminat- 
ing power. 
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Lectures and Readings 
3 hours per week 
for n test with reference to difR- 
culty and discriminating power. 

22) Correcting scores for chance 
success, 

23) The criteria of aa ideal testing 
program. 

Acliiovement tests 
Prognostic testa 
Readiness tests 
Diagnostic testa 


Laboratory work, Problems and 
Observations, 4 Jiotii’s per week 

22) Observing readiness testing and 
follow-up procedures. 

23) Observing diagnostic testing and 
remedial procedures. 

24) Observing a good toachcr-parent 
coiifercncG. 

25) Dcterniining Iho rending cli/Ti- 
culty of ft book. 



3) HOW CAN THE PSYCHOLOGY OF 
DEVELOPMENT IN INFANCY AND CHILDHOOD 
HELP TEACHEHS? 

WILLIAM F. BRUCE 

Stnto University of Now York, State Toncliors Collogo, 

Onconta, New York 

The term, ‘ psychology of dovclopmcnfc,' is used hero to onipha- 
aizc the study of 'relations* among the facts and factors of 
dovelopmeut. Educationnl psyciiology becomes more sciGatifio 
and sound ns it exposes relations between various aspects of 
development, such as those between physical growth and social 
acceptability, between emotional allitndes and intelligent 
response in test situations, or between social class status and 
motivation in school. Tho thousands of factual items discov¬ 
ered by recent investigations in such fields as physical growth, 
intellectual attainment, and sociological studios of youth in 
rural and ui’ban communities, can so fill tho time of instructors 
and students in professional courses that tho psychological rela¬ 
tions involved scarcely can. bo seen or even, vaguely understood. 
If the psychology of development at any ago level is to bo help¬ 
ful to teachers, it must reach far beyond the momorimtion of 
facts into actual comprehension of the processes of development. 

One way of insuring that the teacher understands the psycho¬ 
logical relations involved in development is to study growth with 
an eye upon the characteristic life-styles of particular persons. 
The life-style of a child is his way of walking, talking, meeting 
other children and adults; in short, his way of behaving as a 
whole person. In studying him wo may look analytically at his 
physique, his health history, his family pattern, and his interests 
in and out of school; but our Understanding of him and of the 
psychology of personality comes through relating these various 
parts to the individual's whole life-style. The process by which 
the teacher comes to understand the significance for education 
of tho facts in a variety of fields is by alternating attention from 
the problem presented by tho person’s whole behavior to one or 
more parts of the situation and then back again with suggestions 
about how to guide the child. Thus the student comes to see tho 
particular item as a member of a dynamio pattern of child 
behavior. 
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Since the personality of even a young child is exceedingly com¬ 
plex, the student of educational psychology will find his scientific 
sources classified under such titles as enaotionnl energy and con¬ 
flict, motivation from drive to purpose, and physical develop¬ 
ment. The student-teacher and his college instructor mu.st nob 
allow these analytic categories to break in pieces his concern 
for the well-rounded development of whole persons. These 
materials organized around particular aspects arc to be used in 
discovering and understanding relations that may open the way 
for modification of the child's life-stylo through guidance. 

Another way to keep the enlightening relations in the fore¬ 
ground of the teacher's study of the psychology of development 
is to think of the entire life-cycle rather than treating separately 
such periods as infancy, early cliildhood, childhood, adolescence, 
maturity, and old age. While the ten-year-old's mo.st adequate 
preparation for maturity is living most fully today on his own 
terms according to his own present capacities, the teacher can 
scarcely understand him psychologically without seeing the rela¬ 
tions between his behavior in earlier years and his pre.sent stylo 
of life. Nor can the teacher wisely guide Die ten-yoar-old with¬ 
out a thoughtful look ahead toward the adolescence which is 
fast approaching and toward the maturity that lies beyond. 
Although tho olomentary-.school Leuchcr takes particular responsi¬ 
bility for children of a certain age level, he will understand tlio 
psychology of development at that age more, fully as he 8ce.s it 
in the long context of an ideal life-cycle sfcrctcliing through four 
score years or more. 

A further warning emerges from the discussion of age-level 
periods, such as childhood and adolescence. Too often ole- 
menlary-school teachers and secondary-school teachers in both 
pre-service and in-.service training are faced with courses entitled 
for the former, “Psychology of Child Development," and for tho 
latter, “Psychology of Adolescence." This logitimato diffcrcnco 
in emphasis is apt to lead into drawing sharp lines of contrast as 
though the jump from childhood into adolcsccjico came on a 
particular day and radically changed tho stylo of life. Actually, 
although the first menstruation may be taken as u ])IiyHiol()gicaI 
criterion of tho girl’s leaving childhood and entoring lulolc.sconce, 
her change in bodily form and rale of physical growth often 
becomes evident many months earlier, while her interest in boys 
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may have likewise ohanged earlier or may be much delayed. The 
chief psychological principlea helpful to teachers have to do with 
the continuity of life-style in the midst of growing up and with 
the groat range of individual diffcrcncea in rate of physical and 
eocial development. Since many elementary-school youngsters 
are physically and socially adoloanents, and many high-schoolers 
are still childish in body or spirit or both, and because of tho con¬ 
tinuity throughout tho life-cycle, all toachci’s may well study tho 
psychology of development over a span of life inclusive at least 
of cliildhood and adolescence. 

Since it is our responsibility in this discussion to emphasize 
ohildliood rather than adolescence,* we turn back to the begin¬ 
nings of life to find in these early stages psychological principles 
helpful to the teacher. How much time and emplmsis shall be 
placed upon considering tho very beginnings of lifo involving 
the processes of physiological heredity and pro-natal growth? 
Hero we run llie danger, when wo use a chronological-dovolop- 
ment approach, of getting halfway through tho course before tho 
child is born as wc get immersed in the interesting facts of pre¬ 
natal development. The teacher does need, liowovcr, to relate 
the facts of tho complexity of human inheritance and the unpre¬ 
dictability in particular cases of general capacity and tompora- 
ment to the range of individual differences in the school class. 
Likewise, the pre-natal stage throws light upon the relations 
between endocrine-gland action and physiological growth and 
thereby later intellectual capacity. Birth injuries and partial 
suffocation may be mentioned os added evidence that the 
diversities in general capacity may have causal factors other 
than genetic differences. By linking tho pre-natal and post¬ 
natal months tho dual principle of differentiation-integration in 
physical growth and motor development may become clear 
enough on these relatively simple terms that it may bo under¬ 
stood as a psychological process underlying much of our modern 
view of intellectual and social learning in later years. Thus we 
turn back to the very start of lifo because there tho teacher of any 
level can reach certain understandings of development most 
effectively. 

One problem that students of development raise insistently is 


> Sco dieoussion of adolcsoonce by Br. Glenn M, Blair following. 
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the relative effect upon the whole lifc-cycle of the infancy period. 
Here tho teacher needs much help from the educational psycholo¬ 
gist in reaching a balanced view between extremes. Although 
the public generally and educators particularly have largely 
escaped from the clutches of the fatalistic heroditarians, they are 
plagued by other doctrines to the effect that tho life-style is fixed 
beyond repair or modification in infancy. The hehaviorists and 
sociologists have contended that conditioning factons and the 
cultural patterns early make the person what ho is, and there ho 
stays. Apparently, the teacher is offered no hope that the child 
can be guided nor that the culture can bo improved. The 
Freudians have depicted how the oral, anal, and genital experi¬ 
ences of infancy along with much mislraining in our culture about 
toileting and sex have established a fixed pcr-sonality which feels 
and sees life in unchanged ways oven through tlio adult years. 
Other clinical studies of infants under impersonal institutional 
care have brought recognition of tho need of cuddling tlie baby, 
if wc are to have either healthful physical and social development 
or effective intelligence. Here again the class in educational 
psychology must select carefully and balance evidence judiciously 
if it is to get on witli the study of cliildren supported by a degree 
of confidence that some may mature adequately. On tho other 
hand, to refuse to faco tho ovidonco of tJio profoinul and far- 
reaeJiJng eJTecis of infant experience snbmJiled by IJjo eJinieian, 
the sociologist, and the psychologist of learning is to ))lind t)io 
teacher to the important relations between infancy and later 
childhood. 

Can tho teacher of eight-ycai*-oIds get psychological under¬ 
standing from studying tho behavior of two’s and tlircc's in 
nursery school and four’s and fivc’.s in kindergarten? Tho 
specialists in 'early childhood education’ reply tliat tliia period 
is just the stage in which real understanding can come as the 
student sees these young children forming their individual life¬ 
styles in groups. Certainly, the numerous studies of the social 
development of young cliildren throw a great flood of (•ncouragiiig 
light upon tho possil)iliticH of development witli skillful guidance 
in small groups. Mucli more of tlio favtirnble (diange in (‘Ic- 
mcntary-school practice during rcconl decades can be credited to 
leadership from below in the kimlcrgarlcn than from al)ove in 
the high scliool and tho general college. Tlio relation to the 
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learning process of high energy output of run-about children, 
when rolcasccl in activity among appropriate things for building, 
climbing, and picturing, and among other pre-schoolers and 
teachers with whom one can talk and play, cat and work, has 
been rovealii^g. The teacher of older children will wish to move 
on, however, after careful attention to selected studies of these 
younger children which aro most eigniricanlly related to the 
development of older children. The psychology of tho young 
child, in spite of its vividness, should not Loo much delay the 
student whose responsibility lies with a higher age level. 

What contributions to the teacher’s work come directly out 
of the study of the psychology of development in childhood, say 
at ages six to twelve approximately? Space permits the mention 
of only a few fruitful areas. 

The relations of the physical organism to the cultural environ¬ 
ment is a continuing theme of psychological study at every ago 
level. In this baclc-and-forth process the child becomes a person 
to respect as he takes oii tho language and customs of hia home, 
of his peer group of age-males, and of the wider community. By 
this process, which can be likened to a conversation between two 
people, aometimcB harsh and sometimes friendly, tho helpless, 
hungry infant becomes a child with a measure of intclligcnco and 
of social accomplishment. Fortunately, there aro two aides to 
the process, so that he early begins to remake liis family, his 
play group, hie school class, and even his teacher. This process 
is often labeled ‘interaction/ but it is more than friction between 
two cogwheels, more than tlie wear belwcon auto tire and pave¬ 
ment. It is actually a ‘transaction’ in which a change occurs in 
both the individual and tho society. This process of accultura- 
tioii is creative, although some sociological dtscusaions of cultural 
prMsures and class status sound os if the child was merely being 
‘molded’ by his culture. How the culture is transmitted to 
youth and at the same time is gradually transformed, especially 
in a modern democracy, is a conti*al problem of the psychology of 
development. 

The teacher today finds at hand many now techniques for 
studying the relations of bho individual organism to tho cultural 
environment. Sooiometric techniques help tho teacher to undoi*- 
stand how the children fed about each other; who is accepted and 
who is neglected or rejected. The relations to learning situations 
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can bo traced, and teachers begin to build a vital psychology of 
their own. The studies of class status in typical communities 
give tho alert teacher hints concerning the origins of learning 
failures and successes in family cultore and languago habits and 
in emotional feelings of inferiority, superiority, security, or mobil¬ 
ity strain. The study of groups in action on tho adult and 
adolescent levels is indicating some of the ways in which compe¬ 
tition among tho pupils in a class can be replaced by team work 
of the children, which is at once more rational and moi'e demo¬ 
cratic. Thus the modern teacher gains help from a deeper 
understanding of the child as a member of a class group, and 
teachers may also receive suggestions concerning the development 
of a class of individuals into a group that works dynamically 
with the teacher. 

Some instructors make motivation the central theme of thoir 
teaching. Ilere the studies may range from tho measurement of 
various biological drives in rats to what part of a child’s day is 
given to the movies, radio, and comics in 1950, and on to tho 
ethical purposes that begin to take form in the relatively maturo 
twolvc-yoar-old. In all this study of motives tho important, but 
often neglected point, is the relation between the facts and the 
personality developing in individual children. Many pages liavo 
been written on the psychology of inteveatB involving tUo collec¬ 
tion of much data, in which tho psychology of dcvcloinnent ran 
much thinner than in that old study of young Jolin Dowoy on 
Interest and Effort. Tlie relating of concepts such as interest and 
effort, freedom and control, external and internal diHciplIno, drive 
and purpose, is more useful to the teacher Uian bookfnla of raw 
facts. The psychology of tho development of motivation is still 
a fertile but only partially cultivated field. 

After venturing into cultural inquiries that emphasize group 
processes and considering the possibilities of modifying intcrc.sLs, 
is it helpful to teachers to look at the individual again in terms of 
a personality or ‘self’ seeking mnturity? Such an analysin of 
tho 'self' into several more or less related pliascs aids tlie student 
in understanding children and iucidontally his own more-or-lcss 
mature ‘self.’ CorLainly, psychological (listinetionH arise out of 
considering the‘self’ (1) which he has, (2) whi(5h he Ibiiikslu* has, 
(3) which oLliers think he has, and (4) which he thinks ho ought 
to have. Using tho contributions of pbilosophors, psycho- 
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analysiats, and lay observers the teacher may learn to distinguish 
among (1) the actual behavior of a child, (2) that child’s own 
description of his behavior with its rationalizations, cxcubcb, and 
escapes, (3) the biased evaluations of others, particularly the 
teacher's own estimate, and (d) the ideal or super-Ggo to which 
tile child aspires. And before the teacher leaves the study of the 
psychology of development he may become concernccl to uncler- 
etand himself more fully and to overcome some of the personal 
harriers that stand between him and accurate study and wise 
guidance of the children. Among these barriova within the 
personality may be mentioned a wooclennc.sg or lack of inspira¬ 
tion, extroverted showmanship, compulsive rigidity, jiersisting 
fatigue, continual fear for one’s security, dependence upon others, 
and lack of self-discipline or organization in one's life. For the 
teachei', and all of us, are only part way along the road to matur¬ 
ity, Wc are still seeking an integration in wliicli our four selves 
come into more intimato relation and closer unity with each 
other. As aids in this creation of mature integrity in the person 
we have on the one side tho resources of child-analysis and self- 
analysis and on the other the ability to clarify tlic goals for per¬ 
sonal development that are possible and dc.sirablo in a culture 
aiming to be more free, more responsible, more democratic. 

If there have crept into these suggestions on the ‘content' of 
the psychology of development certain assumptions about 
‘methods’ of instruction in this area, Ave can only plead that 
content and method are as inseparable as organism and oxygen 
in breathing, as organism and culture in human development. 
Although considerable contact with cliildvcn by the pre-aevvice 
student is hero considered essential, tho relation betsveen experi¬ 
ences with children and the organization of courses in the psy¬ 
chology of development presents many problems. How useful 
are case studios that arc read, that are seen in movies, that are 
made through a period of .study of actual children? How early 
shall child eontacta, on the one hand, and logical organization of 
psychological subject matter, on tho other, be introduced? How 
fully aware should the student bocomo of the effects of group 
work upon their own personal development, blioir rapport with 
children, and their learning in this area of human relations? 
Such questions indicate the diflicuUies in the adequate education 
of teachers at present with the limitations of resources, personnel, 
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and time. It does appear economical to aim at the teaching of 
concepts and generalizations, which are understood well onoiigli 
to be transferred readily to new situations teachers will meet, 
remembering that the adequate understanding of these principles 
and policies can come only through experiences that have con¬ 
creteness for the student. These concepts comprehend sets of 
vital relations which give them psychological power. 

The mention of certain crucial problems in tlieso pages is 
intended only as BUggestive for other teiichcrs of educational 
psychology. The selection of both content and method depends 
upon the class membership and institutional conditions, For 
example, in many colleges tlie student will come to the course in 
child development or educational psychology well informed on 
some of the biological, psychological, and sociological problems 
in our list. Each instructor needs to map out his own area of 
responsibility in relation to other fiolds. He must establish and 
modify from year to year his own pattern of instruction. Com¬ 
munication throughout the field of educational psychology is to 
be encouraged to the end that each instructor will have at hand 
a wide variety of suggestions from his colleagues across tlio 
country as well as within his own faculty. Then it becomes the 
responsibility of each instructor to develop the kinds of courses in 
education which will promote in the studeiits whom ho mools 
such an understanding of the psychology of tlevelopment ns will 
further the maturity appropriate for living in a doinocratio 
community. 



4) WHAT TEACHERS SHOULD ICNOW ABOUT 
THE PSYCHOLOGY OF ADOLESCENCE 

GLENN M. BLAIR 

Pi'ofoasor of EcUicalional Paycliology 
Univcreily of Jltinoiii 

Tho question ha.H sometimes been raised as to whether fcliore is 
any unique content to tho field known ns tho ‘psychology of 
adolescence.’ It has been argued that the adolescent is a human 
being and is subject to the general laws of human behavior tho 
same as anyono else; and that one who thoroughly understands 
tho basic general pvinciplcB of development, learning, and adjust¬ 
ment will be amply qualified to deal with any adolescent problem 
that might arise. Those taking this viewpoint also might assert 
that all specialized courses in psychology overlap with every 
other course. Tho instructor teaching tho course in general psy¬ 
chology will refer to the people about whom lie talks as ‘subj ects'; 
tho teacher of the educational psychology course will utilize the 
word 'pupil' in liia discussions; tho course in child psychology 
will employ tho term 'child'; and the course in tho psychology of 
adolescence will suhaUtutc tlio word ‘adolascont’ to take the place 
of such words as ‘subject,’ 'pupil,' ond ‘child.’ In all other 
respects tho courses I have just referred to would bo very much 
alike if not indistinguishable. There is, of course, an element of 
truth in this typo of argument. Courses in psychology inevitably 
overlap and reinforce each other in terms of basic theory. And, 
as often taught, the amount of ovorlapping may be so great that 
the distinctive contributions of a given specialized course may 
not be realized, 

The present writer takes tho position that what we know about 
human behavloris applicable to understandingtho adolescent, but 
that the period of adolesccnco has special problems whicli require 
additional study. There is a growing body of valid information 
concerning the period of adolesccnco which is usually given but 
slight attention in general books and courfio.s in psychology. 
Much of this is of the greatest importance to teachers 'who work 
at the secondary-sohool level. The purposo of this paper is to 
briefly call attention to some of this material. The special 
problems and principles of adoleaoont development to be dis- 
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cussed will be presented under the following four headings: (1) 
Adolescence—a transition period, (2) Adolescence and the cul¬ 
ture, (3) Biologioal changes and the adolescent, and (4) Develop¬ 
mental tasks of adolescence. 

A.DOL13SCRNCE—A. TRANSITION PERIon 

The teacher who works witli individuals of adolcsoont ago 
should realize that this period represents one of the chief transi¬ 
tion stages of one’s development. It is a time when the indi¬ 
vidual is attempting to make the switch from a childhood r61o 
to one of adulthood. This task of changing from a child to an 
adult is entirely new to the individual, and one which he will 
not have to face again during his life span. 

During adolescence the individual is neitlicr a child nor an 
adult. Ho is ofton treated in an ambiguous manner by hie par¬ 
ents, teachers, and other members in his society. Ho is told one 
moment by his parents, for example, that lie is loo young to 
drive the family car; the next moment ho is informcti that ho 
is too old to lie carrying on certain childish antics sucli us crying. 
Roger Barker has stated that “for the udolcsconL, the overlapping 
situations of cliiUlhood and adulthood arc paramount. Adoles¬ 
cents, by virtue of their frcquontly ambiguous and rapidly 
changing physiques, are often placed in marginal siUiationH witli 
the physiological, social and p.sychologicnl behavior detonniners 
of botli childhood and adole-sccnce acting uj)on them simul¬ 
taneously.”^ It is very probable that the vacillating and 
unstable behavior often ullributcd to adolc.seGul3 is duo to tiio 
fact that they find themselves in new and overlapping situations 
where their r51e is not structured, 'i'eachors need fundamental 
insight into the psychological processes involved in such situa¬ 
tions in order to understand the adolescent and to help him 
define his own rOlcs more clearly. Tlic topological theories of 
ICurt Lewin and his followers arc particularly helpful in providing 
an undcTsUindiiig of tiio problems fuised by adolc.sconta (luring 
their transition from childhood to adulthood.* 


' lloROr Ilarkcr, ct al., Ailjuslment lo Physical Ilanilirup ntid llhicsii: /I 
S^irvcy of the fiocial Psychology of Physiiiue and l)mtbiUiy, St>cial Scionoo 
Ilcsearoh Council Bulletin 65, Now York, 1940, i). 33. 

* Sec Roger Barker, ot al., ibid, pp. 22-4'l. 
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ADOLESCENCE AND THE CULTUBE 

All hurnan behavior is, of course, to a groat extent influenced 
by the culture in which it is surrounded. Particularly marked, 
bowevcv, are the ofTects of culture upon adoleaconfc behavior. 
The length of the period of adolcsoenco, for example, depends 
upon the way society treats the adolescent. In some primitive 
societies children are transformed into adults almost over night. 
At thirteen or fourteen years of age they are given adult responsi¬ 
bilities and quickly weaned from the family. In our own culture 
in pioneer days it was not at all unusual for young people to 
marry at fourteen or fifteen years of age and take on family 
responsibilities. Such individuals probably had at the most one 
or two years to bo adolescents. More recently, particularly 
during the depression years, it was not at all uncommon for 
young people to spend ns much as ten years in making the transi¬ 
tion from childhood to adulthood. During the recoiit war, groat 
numbers of boys wore automatically matvu’od into adults upon 
roaobing eighteen. At this ago they left homo and ontered the 
service of their country, thus cutting short tho usual period of 
dependence upon Ihciv families by several years. 

The typo of culture which surrounds tho adolescent nob only 
determines tlie length of the period, but produces well-known and 
distinguishable effects upon his behavior and personality. 
Margaret Mead several years ago documented the fact that 
young people in Samoa did not act like individuals of comparable 
ages in the United States. Because of the way they were roared 
these island boys and girls seemed to be lacking tho symptoms of 
'storm and stress’ which are reputedly exhibited by our own 
youth. 

Anthropologists and sociologists, who have studied the 
behavior of adolescents reared in dilTcrent cultural settings in our 
own country, report great differences in the behavior patterns 
found. Allison Davis states that "lower-class culture, white or 
Negro, organizes adolescent behavior with regard to aggression, 
sexual relations, age rdlea, and family rQles . . . into patterns 
which dilTer radically from those of middle-class adolescents."^ 
His evidence shows that what is rewarding to a middle-class 

'Allison Davis, “Soci/iliaation and Adoleacont Porsonalily," in 43rfl 
Yearbook of tho National Sodety lor tho Study of Education, Part 1, 
Adolescence, 1044, p. 200. 
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adolescent ia not at all so to an adolescent ronved 5n the lowor- 
classca. Their attitudes toward sohoolworlc, what tJioy fear, 
crave or cherish arc distinolly different. Similar findings and 
conclusions are reported by Hollingshead in his study entitled 
Elmlown’s Youih.^ The material to be found in such studies is 
of the greatest significance to teachers who would understand 
the behavior of adolescents enrolled in their classes. Of value to 
teachers, also, are studies which have been made of the adolescent 
peer oiiUure within a given social class. Such studies show how 
value patterns change with increasing maturity and how status 
within the peer group is attained. A good example of this typo 
of investigation is Caroline Tryon’s Evaluations of Adolescent 
PcTsonaliiy hy Adolesce7its.^ 

BIOLOGICAL CHANGES AND TUB ADOLIiSCBNT 

An individual, of course, only has to face the facts of puberty 
once in his life. Tlic adolescent's changed body creates new 
psychological problems which ho must meet. Tlicrc arc the 
problems connected witli voice change, adolescent aono, somatic 
variations, early and late development, etc. Kspcoially impor¬ 
tant data regarding psychological prolilcms i'o.snlting from jibys- 
ical clianges and development during a<loic8cenfie hiivo come to 
us from the California Growth Study. Stolz and Stolz® liavo 
cataloged the physical disturbances and body variations which 
worry adolescent Ijoys and girl.s, and Harold E. Jones* has 
reported on the psychological effects accompanying early and late 
development. His data show clearly that tlie early maturing 
girl is faced with more serious adjustment problems than the late 
maturing girl or the early or late maturing boy. The studios of 
Stone and Barker® on tlic attitudes and inlerc.sts of prcmenarchoal 

* A. B. HoJImgshcad, Elmlown's Voulh, Now York, John Wiley find Soiif?, 
1940. 

* Carolino M, Tryon, Evalualions of Adolescent Pcrsonalily hy Adolescents, 
Monographs of tlio Society for Kcscarch in Child Developnicnt, Vol. IV, 
No. 4, Wnshinglmi: Nationiil Kesenreh Council, 11)39. 

* Herbert R. Htolz and IiOi« Meek Klolx, “iVchilcHcciil ProblcmB lleldlccl to 
Somatic VariatinuK," in 43rd yonriioolc of the Nuliiuml St)ci(!ty for tho 
Study of Education, Pari I, Adolescence, I944, pj), RO -99. 

* Harold E. Jones, "'riie Cyclo of Puhorty." Papciv lonil at Llio Fifty- 
sovcntli Annual McoLing of the American I’flychological Association, Himvor, 
Colorado, September, 1949. 

* C. P. Stone and R. G. Barker, “Tho Atlitudos and Interests of Pro- 
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and postmenai’clieal girla have also given us increased insight 
into the efTccta of puberty upon the outlook of the developing 
child. The data show tJmfc among thirtcen-year-old girls, those 
who have menstruated arc far more mature in their response.^ 
than those who have not. Specifically, the postmcnarcheal girls 
indicate more heterosexual interests, more interest in adornment 
and display of their por-sons, and loss interest in participation in 
games and activities requiring vigorous activity than their pre- 
menarclioal age mates. 

Tlio teacher who would wisely counsel adolescent boys and 
girls should be in possession of these and many other facts which 
have to do with adjustment problems stemming from biological 
and physical ehaugo during adolescence. 

D13VBI,OPMENTAL TASKS OP ADOI.ESCKNCB 

Individuals of every ago group have problems which must 
bo successfully solved if normal adjustment is to bo maintained. 
The nature of these problems varies considerably at different 
periods of the life span. The infant or small child must master 
the oomploxitica of learning to walk, learning to talk, ajid con¬ 
trolling the elimination of waste products of the body. The 
young adult has such special problems as learning to Hvo with a 
spouse, reaving oluldren, and securing a place for himself or her¬ 
self in the occupational world. The midcllc-agod adult has such 
new problems aa living harmoniously with adolescent children 
in the family, adjusting to physiological changes occurring during 
the menopause, if a woman, or adjusting to decline in general 
physical capacity, if a man. Still older people often have such 
unique problems to deal with as adjusting to retirement, or living 
alone after the death of a husband or wife. Robert J. Havig- 
hurst^ has made a special study of the typical and somewhat 
unique problems facing human beings at various stages of their 
existence. He calls these problems or special learning activities 
’developmental tasks.’ He has suggested nine basic problems 
or tasks'* which the adolescent must master if ho is to achieve 
a successful adulthood. They aro as follows i 

monarchcal and Postmonnrchonl Qirig,'* Journal of Oenctic Psychology, 
Vol. 64, 1930, pp. 27-71, 

1 Robert J. Havigliurst, Developmental Tasks and Bducalion, Chicago, The 
University of Chicago Press, 1948. 

^ Ibidf pp. 30-63. 
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1) Accepting one’s physique and accepting a masculine or 
feminine r61e, 

2) Developing new relations with nge-mates of both sexes. 

3) Attaining emotional independenco of parents and other 
adults. 

- 4) Achieving assui’ance of economic indopondence. 

6) Selecting and preparing for an occupation. 

6) Developing intellectual skills and concepts necessary for 
civic competence. 

7) Desiring and achieving socially responsible behavior. 

8) Preparing for marriage and family life. 

9) Building values in’ harmony with an adequate scientific 
world-picture. 

Problems, such as those just listed, are not entirely unique to 
the adolescent period, although some of them are. They are all, 
howevei’, tasks upon which adolescents must work during tho 
transition period from childhood to adult status. Teachers 
sliould understand in great detail the nature of these problems 
if they arc to minister to tho needs of youth, and succeed in reduc¬ 
ing the stress and strain so common in adole.scont development. 

coNcnuaiON 

No attempt has been made in this paper to outline what teach- 
61 VS should know about psychology in general or evoji to catalog 
detailed information the teacher should po.H.Hea.4 regarding adoles¬ 
cent development. Tho purpose has been to suggest several 
areas of investigation concerning adolcsccnhs which receive scant 
attention in general psychological di8Cua.sion.s of behavior and 
whicli })avo ^special significance for lencliers who work with 
individuals of adolescent age. It has been shown that tlie 
adolescent has special problems which he did not have ns a child 
and which are somewhat different from tliosc ho will cucounter 
as an adult. He ha.s certain pressing needs whioli must be met, 
and a series of developmental tusks whicii lie must ma.stcr if ho 
is to become a solf-Hufficient member of society. The successful 
teacher should uiiderslaiul wluit these problems are and how 
to assist the aclolascent in resolving them. Knowledge of liasic 
behavior theory i)lua apccializcil mforraaUou regarding tho period 
of adolescence and tho individual adolescent aro prerequisites 
for this task. 



5) WHAT THE PSYCHOLOGY OP LEARNING HAS 
TO CONTRIBUTE TO THE EDUCATION 
OF THE TEACHER 

G. I.ESTER ANDEUSON 
Dean of Tcaclior Etlucalion, Now York City Colleges 

It ia the objective of this papev to explore the pUtco of the psy¬ 
chology of learning in the ctlucalion of the teacher. This objec¬ 
tive is a part of a larger objective—that of determining a cur¬ 
riculum for teacher education. Our limited ol)jeclivc should be 
approached in terms of what it ia,—a curriculum problem. The 
fairly well standardized procedures for curriculum work should 
be followed in the exploration of the place of the psychology of 
learning in the teacher education curriculum. To follow these 
procedures, anawors would bo found to questions of tlio following 
type: 

1) What ia the work which teachers do or should do? 

2) What education (or training) does ti>c ioachor need in order 
to begin to do his work? 

3) What aro the oxporienccs the tcachor-in-training must have 
if ho is to become an educated tcaclior? 

Wiicn those questions are answered, wo can then nslc: Aro any 
of the experiences wliich tcnchcrs-in-trnining should liavo sub¬ 
sumed, under present academic labeling, in n course or section 
of a course which can be called the psychology of learning? 

Let us very briefly review what all of us miglit say in answer 
to these questions, as these answers would have relevancy in 
determining the place of the psychology of learning in the teach¬ 
er’s education. Because we can ossumc that learning has its 
most important contribution to make to the teacher’s rdlo gua 
teacher, this brief discussion will be ixjstrictGd to what are essen¬ 
tially instructional and curricular aspects of the teacher's W'ork. 

The task of the teacher gua teacher can bo briefly stated as 
follows; (1) To determine the goals of education and tho con¬ 
tributions a given teaching area makes to tho.so goals. This ia 
tho problem of objectives. (2) To determine the capacities of 
those being taught to attain these objootivoa. This is tho prob¬ 
lem of determining objectives for each individual learner. (3) 
To determine tho experience which tho loarnev is to have in order 
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that he can attain his goals through learning. This is the prob¬ 
lem of setting the curriculum. (4) To organize these experiences 
in terms of their scope and sequence so that learning will be at a 
maximum. This is the problem of determining the course of 
study. (5) To guide the learner in these experiences, again so 
that learning will be at a maximum. This is the problem of 
methodology. (6) To test the learner to see that individual 
and hence the educational goals have been attained. This is tho 
problem of evaluation. 

If the teacher is to perform these tasks, experiences which 
utilize a body of knowledge which we call the psychology of 
learning would certainly seem to be implied. Is it not axiomatic 
that a teacher must understand the learning process and be a 
guide or director of learning to the individual students under his 
tutelage. If this statement is acceptable we can then proceed 
to other issues. How teachers arc to come to understand tho 
nature of the learning process, the necessary depth of this under¬ 
standing, and how they are to learn to direct learning wisely 
are the moot points. Let us address ourselves to some of tho 
problems that thus emerge. 

Psychology of learning should probably bo part of a basic 
course in educational psychology. This course will be included 
in the teacher education curriculum at some point before work 
in method or in practicD-teaching. We sliould like to make thoso 
assumptions about the teaching of the basic course in educational 
psychology. 

1) General psychology should bo a prerequisite. 

2) Educational Psychology will maintain an identity as a body 
of knowledge in tho teacher education curriculum. 

3) Educational psychology will not be taught as a lecture-text¬ 
book course but will be taught in harmony with tlio best concepts 
of college teaching. Laboratory and field work, with caso 
studies of pupils, observations of learning situations, etc., will be 
an integral part of the course. 

4) Tlie basic material in learning as a part of the courso in 
educational psychology sliould probably be cclcoUc in character. 
LilToronccs in tlicoiy have importance and Hignilicanco for edu¬ 
cational praoticQ, but a detailed exposition of the different theo¬ 
retical positions probably has little place in an undergraduate 
course in learning. 
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Wlmt shall be the content of the section dealing with learning 
in the basic educational psychology course? The following major 
divisions are suggested: 

1) The general nature of learning. 

2) The motivation of learning. 

3) Transfer, retention, and forgetting. 

4) Nature and direction of learning primarily motor in 
ebnraotor. 

6) Nature and dirccUon of learning primarily intellectual in 
character. 

6) Nature and direction of learning primarily social and atli- 
tudinal in character. 

From the study of these topics the teacher-to-be should develop 
an understanding of basic concepts, and certain generalizations 
or principles about human learning, and come to sec tlio relevancy 
of these for the performance of his responsibilities when ho 
becomes a teacher. 

Blair, among others, has shown that wo arc not yet ready to 
produce a definitive list of concepts and ju’inciplcs that can be 
generally agreed upon by cducationiil psychologl-sts which all 
teachers should understand, But wo must begin systematically 
to produce such lists which can become basic olcmonts of this 
section of the teacher education curriculum. 

We have the following in mind as examples of learning con¬ 
cepts: motivation, incentive, need, interc.st, reward, praclico, 
transfer, gonoralization, integration, inhibition, goal, effect, and 
experience. 

We suggest the following os illustrative of principles which 
might be established: 

1) Practice ia a necessary but not a sufficient condition for 
learning. 

2) An individual loams the responses which bring him to the 
incentives which satisfy motives. 

3) Forgetting occurs not as a function of disuse of a particular 
behavior but because of the interference of now learned boliavior 
with previously learned behavior. 

4) Motivation without an appropriate incentive is inoffcctivo 
to produce learning. 

This approach, suggesting that teachers must understand con¬ 
cepts and principles whioh are dehnitely psychological in char- 
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acter, may seem formidable. Some "would make the approach 
purely on a problem and direct experiential basis; that is, teach¬ 
ers would learn their psychology of learning by observing and 
working with children in learning situations, and would Hake 
from’ the discipline which is the psychology of learning only 
those things which bear upon a problem the teachor-as-atudent 
faces in his work with children. This latter approach seems 
unsatisfactory if the teacher is to be trained as a professional 
practitioner rather than as a technician. It is only as a teacher 
masters the disciplines which bear on his work, as, for example, a 
physician masters anatomy, that he can be considered to have a 
professional education. 

We should like to state immediately however, that instruction 
in this area should provide the teacher-in-training abundant 
opportunity, through direct experience wilh children as they 
learn, to sec the concreteness and reality of the concepts and 
principles of learning which are abstractions, per se. 

By way of conclusion, we should like to repeat how tho psy¬ 
chology of learning makes its contribution to the valid perform¬ 
ance of tho teacher's task. 

The psychology of learning should give some clues as to what 
is attainable on the part of the learner. Consequently, the 
psychology of learning can give reality to educational objectives. 
It can prevent educators from setting as goals the unattainable. 
This has too frequently occurrecl in educational history and has 
represented groat wastage in educational endeavor, and frustra¬ 
tion for those presumably being educated. 

The psychology of learning plays a r6Ic in curriculum building 
in that it gives clues to the moat appropriate organization of 
content and activity for purposes of learning. 

Evaluation should l>e made in terms of behaviors to Ije learned. 
Again, through tlie psychology of learning the teacher may come 
to bettor understanding of what is to bo evaluated and may 
better determine tho appropriate techniquos for doing this. 

But tlio psychology of learning should play its central i'61o in 
methodology. The problem of method is the problem of direct¬ 
ing or guiding the learner in the experiences which will produce 
desired changes in hia behavior. 



6) THE STUDY OF INDIVIDUAL DIFFEHENCES 
IN THE EDUCATION OE TEACHERS 

FIIANK S. FEEEMAN 
Come]! Univcrflity 

r 

Every teacher knows, and ao does every etudont preparing to 
teach, that people dirCoi' among thcmaelvca in vcapect to every 
human trait: physical, intellectual, emotional, social. In fact, 
educational philosophers and practitioners, beginning at the latest 
with Plato and Aristotle, have been aware of wide individual 
variations in mental ability and in the nonintellcctive traits of 
personality. Until relatively recent years, however, most edu¬ 
cational philosophers and practitioners did little about the matter 
except, for the most part, to take a prc-dclerministic and fatalistic 
attitiiclo toward individuals and to eliminate those wlio appeared 
unable to learn a prescribed minimum in rigidly conceived cur¬ 
ricula and courses of study. 

It is less than fifty years that individual diffcroucos have been 
widely studied scientifically and subjected lo quantilalivo meas¬ 
urement. In saying this, the pioneer work of Francis Gal ton 
nearly a century ago is not being overlooked; nor are the early 
exploratory investigations of Alfred Binet in the 1880's and 
1890's, and the contributions of a group of American psycholo¬ 
gists, notably James McKeen CatlcU, prior to 1000. But 
extensive and intensive scientific i)sychological study of indi¬ 
vidual differences in man really dat^ from Alfred Binet’s first 
intelligence scale of 1906. 

After the publication of the first Stanford-Binet scale in 1916, 
and more especially after the program of psychological testing in 
World War I, wo saw in this country an enormous number of 
studies contributing to the body of facts coiiccrning human varia¬ 
tions in respect to a great variety of psychological functions and 
educational achievomont. The data of these studies wore 
analyzed for the purpose of determining tho causal factors of 
variationa: differences due to sex membership; to ago during tho 
periods of growth and decline; to racial membership; bo national 
origins; to immediate and to remote ancestry. Studies were 
made of variations due to environmental factors such as socio- 
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economic status, childhood diseases, the amount and quality of 
schooling, cultural resources of the community, and the like. 

Throughout these studies, either implicit or explicit, was the 
ubiquitous basic and primary problem of 'heredity and environ¬ 
ment'; or what Galton so aptly named, the 'nature and nurture' 
problem. In a democratic society that has a system of universal 
public education, from the first grade through the university in 
nearly all states, and in a society that professes to provide equal¬ 
ity of opportunity to all, and to foster all human capacities and 
human resources, the nature-nurture controversy ia of funda¬ 
mental importance not only to psychologists but to educators as 
well. Indeed, it is of fundamental importance to all who arc 
concerned with education and with the society served by our 
educational institutions. For upon the resolution of that con¬ 
troversy, and upon the psychological and educational principles 
emerging from it, will depend to a very considerable extent our 
educational and social implementation of democratio educational 
doctrine; and, indeed, upon these emerging principles and prac¬ 
tices will depend, to a significant degree, tlic mental health and 
personality development of many hundreds of thousands of 
American children and youths. 

The nature-nurture controversy was considered important 
enough by the National Society for the Study of Education to 
warrant their devoting two Ycavljooks to the subject; first in 
1928 and again in lOdO. In the first of these, the division was 
quite sharp as between the two oppasing 'schools' of thought: the 
rather strict hcreditariaus and the environmentalists. Through¬ 
out the IQSO’s the number of researches on the problem increased 
and the debate continuod—sometimes becoming more visceral 
than scientific and intellectual. Nevertheless, the gap between 
the opposing interpretations and developmental principles of the 
two groups has narrowed considerably, so that now nearly every¬ 
one attributes some significance to psychological nurture, and 
nearly everyone recognizes that genes arc among the basic factors 
to be considered in mental development. 

What has been said thus far i.s well known to all psychologists 
and educators who have studied the subject of individual cliOer- 
encea. They know the field in respect to factual data, theory, 
and implications for social theory and educational pructico. It 
is essential, also, that teachers, school counselors, and school 
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administrators sliould bo familiar ■with the background of this 
subject, with reprosentativo and significant studies in the field; 
and especially with the development and present status of 
theories regarding tlic nature and causes of individual difTcrcnces: 
that is, differencos among individuals and differences within each 
individual himself. 

It is essential that teachers and other educators should know, 
for example, that the range of meaHured mental aiiility in grade I 
is x-years above and below the mean. For without such knowl¬ 
edge, eound and effeclivo inslructioiiul planning and method are 
not possible, and classrooms would revert to the former lock-stop 
matliods. It is essential, also, that educators should know the 
ranges of abilities, both general and special, in sulisequent 
grades; and they should know that the riingo.*! of absolute differ¬ 
ences increase with older age-groups until the maturity level is 
reached, as found under present conditions of mental develop¬ 
ment and M'ith the use of present instruments of mcaHUrement. 
So far ivs teachers, counselors, and school administrators are 
concerned, in respect to individual dilTcrcnce.s, they are faced 
with an actual condition as it exists at a jiarticuhir time, and for 
which they must make the most clTcctivc cduwitional provisions 
poasiblo. For such provisions, knowledge of the perliuont facts 
of vai’iatiov\9 in vespeet to gonoral aWUty, vending vivtc and com- 
pYohension, spehing, manipulation of arithmetie pvocosacs and 
arithmetical problem-solving, emotional and social maturity, 
physical maturity, etc. aro necessary. 

Unless teachers, oouneelora, and cdueatora are to accept the 
reported data of human variations as fixed and predetermined 
'by natui’C,' resulting in a rigid educational and social outlook, 
they must lvno\v also the theory that has evolved from the many 
years of research. For as Pasteur said, "... without theory, 
practice is but routine, bora of habit. Only theory can bring 
forth and develop the spirit of invention." Without an under¬ 
standing of Iheorotical hiicipi'etations of individual differences, 
teachers can l)e only rule-of-thumb technicians; and as such they 
cannot have the necessary insights into the bcliavior and learn¬ 
ing of thoir pupils for the fostering of optimal dovelopinoiit. 
Through an unclcrstaiKling of roseareh and einorging theory, 
teachers and administrators can best appreciate and develop 
the practical applications. 
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There is a tendency in some quarters to depreciate, if not to 
scorn, the work and contributions of theorists. Just as a 
reminder, therefore, we may name, for oxaraplo, tiio following 
men of the modern period who were or are primarily 'theorists,' 
but who have made major contributions to modern educational 
practicet John Dewey, C. H. Judd, Alfred Binct, J. MoK. Cattell, 
E. L. Thorndike, C. Spearman, L. M. Tcrman, W. F. Dearborn, 
B. H. Bode, W. C. Bagley, W. H. Kilpatrick, and the Gestalt 
psychologists (notably Lewin, Wertheimer, Koehler, KolTka, and 
R. M. Ogden). 

II 

Specifically, then, in what areas should educators acquire 
scientific knowledge and theory, aa related to the subject of 
individual differences? Without implying an order of relative 
impoi’tancc, the following topics should bo dealt with. 

Human genetics: not only to understand the biological mech¬ 
anism of human inheritance, but in order also to midcrsLand the 
reasons for and the possibilities of genetic variations within any 
family, as between parents and siblings and between siblings 
iliemselvcs; to understand that genetically a cliild i.s not necessar¬ 
ily fated to be ‘like’ bis parents or siblings, and that an indi¬ 
vidual’s genetic potentialities cannot be determined from general 
laws and general IrctidH. 

Intrafamily correspondence and difTerence.s: to follow directly 
the study of genetic principles and to demonstrate those prin¬ 
ciples, as well as to show the inllucnces of environmental factors. 
Under this topic would bo included the familiar .subjects of 
parent-child and sibling relationships, studies of fraternal and 
identical twins, and of foster children. From these materials, 
the principle of interrelationship and interdependence of nature 
and nurture dearly emerges. 

Differences due to racial or national origins: to understand 
their relations to cultural factors (social, economic, educational) 
as these differ among nations and among racial and national 
groups within one nation (caste and c1u.hh nK'niberKliip). Know¬ 
ing the facts of imlividuivl tUffcrcnecs in rcaiH'-ct to racial mcml^cv- 
ship or national origin of purcuts is, of course, uccessary; but 
knowing the causal relationships between psychological traits 
and social forces is essential if we are concerned with implc- 
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menting a democratio philosopliy of education. For, without 
knowing these causal I'clationshipa, how can wo hope to under- 
Btancl the reasons for existing conditions and the means 
whereby we, as social scientists, may remedy present defects and 
deficiencies? 

Differences due to socio-economic factors: to understand these 
factors and tlieir relationships to parental occupation, family 
income, typo of community; and all that these conditions imply 
with respect to educational opportunity, dovolopmontal rosouroea 
in the home, educational motivation and tradition. The study 
of this aspect of the subject should include among otliers, the 
investigations made in remote and psychologically impovcj ished 
areas (e.g., isolated mountain children, canal-boat children); 
studies of children in rural and urban areas; of the influence of 
nursery-school attendanco upon measured abilities, at one end 
of the educational atrncliire, and of liigh-school and college 
attendanco at the other end. Under this caption, difforonces in 
abilities due to sex momborsliip might also bo included, since 
they are largely culturally dctei’miucd, although in a much 
emallor degree biological factors are also operative, us in the 
more rapid early rate of development of girls. 

The nature and causes of so-called special abilities and dis¬ 
abilities: to clarify the facta regarding the distribution of abili¬ 
ties, especially in music and graphic arts, and of mechanical 
skills. But it is equally important that individual difforonces in 
these abilities be viewed in the light of the general lack of edu¬ 
cational opportunities and emphasis in thc-so arts and skills in 
the lives of the vast majority of children, as compared with the 
heavy educational emphasis placed upon clevolopmont of verbal 
and numerical abilities. By contrast, to domonatrato that 
these abilities are not mei'cly the unfolding and expression of 
‘heredity,' the lives and training of distinguished persons in these 
fields should be studied in order that nature and nurture in these 
abilities may be seen in proper perspective. Nor, in this con¬ 
nection, may we neglect the influences of the social value or lack 
of value associated with a field of study and whicli consequently 
alTects purpose and motivation. 

Differences in mental organization: to demonstrate that while 
many abilities arc significantly or highly correlated, they are by 
no means perfectly correlated; tlmt individual profiles of abilities 
differ, and that effectiveness of mental operations in complex 
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situations depends upon the organization of the several psycho¬ 
logical functions. 

The psychology of the more extreme deviates: namely, the 
mentally deficient, the gifted, the non-reader, the physically 
handicapped, and the sensory handicapped. While most of 
these groups are regarded as the more extreme deviates on a 
continuum, their remoteness from the modal area is so great as 
to create qualitative dilTcrencea which cause special piobleina of 
psychological adjustment and educational practice. 

The individual as a whole: to demonstrate the current concept 
that an individual at all times functions as a whole. Thus the 
study of personality development and personality factors is 
essential for a fuller appreciation of individual abilities and their 
operations, This aspect would encompass the usual range of 
non-intellective personality traits, including values, attitudes, 
and interests in their relationships to the general culture and the 
subcultures within which everyone lives and develops. 

Before a teacher or prospective teacher could undertake the 
study of the foregoing aspects of the comprehensive subject of 
individual clifToreiices, preparation in several other basic fields is 
indicated: namely developmental psychology, the psychology of 
motivation (what is commonly called 'needs' or 'drives'), psy¬ 
chological and educational testing, and clomontary statistical 
reasoning. Without adequate preparation in those basic sub¬ 
jects, the educator will be seriously liandioappcd in evaluating 
and interpreting tlic significance of the fuciual materials in the 
study of individual dilTeroncc.s. 

If all these suggested fields of study appear to be a large order, 
then tlic only answer to be given is that the profession of leaching 
is a complex and significant one; and preparation for it, tliercfore, 
needs to be complex and intensive. 

A democracy is one of the most exacting forma of society in 
terms of its requirements in individual responsibility. That 
being the case, the teaching profession is the keystone of the 
arch, especially at the olcmcnlary- and Heconclary-scliool levels; 
because it is here, in these phusos of life, that tlie foundations and 
patterns of living are developed. Thus, in addition to practical 
training and experience, the professional jircjiaration of teachers 
domaiid.s the kind of scientific and theoretical study that is the 
distinguishing clmractcristic between the professional and the 
technician. 
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ICquippcd will; tlio information and theory concerning indi¬ 
vidual differences—both inter- and iiitm-individiuil—educators 
will be in a much more secure position to evaluate current educa¬ 
tional prttcLicoH and to develop others. They will be in a sounder 
position to judge tlie results of psychological procedures which so 
profoundly affect educational practice and philosophy, li’or 
example, they will be able better to interpret the Jneaning of an 
IQ and will not bo unduly influenced by imcriti(!al cntlmsinats of 
mental testing, nor by the misinformed who reject the IQ 
because it is not as invariable as the movement of celestial bodies. 
They will be better able to cvaUiatc the arguments for ami against 
ability grouping. Tlicy will be freed from the tendency to pass 
judgment upon a child or adolescent on the baaia of his akin color, 
parents' national origin, parental occupation, eiblingts ability, or 
aex momborshii). They will luivo a clearer conception of the 
concept of 'the child as a wiiolc,’ often so vaguely employed, 
They will also be aware of the fact that while Llio range of indi¬ 
vidual variations in ro-spect to any trait is great, and while every 
person as an integrated whole is unicpic, a very largo portion 
of the members of a culture or subculture have much in common, 
in regard to mental abilities and basic needs; and, that witliin a 
given culture, they have much in common regarding tlmir modes 
of living and acting. This commiinality of al)ilitio8, needs, and 
traits is especially apparent in the large group of persons who 
constitute tlie ‘average group’; tliafc is, approximately the sixty 
per cent who are at or relatively close to the central tendency of a 
distribution. 

No one in any profeesion can be prepared, in a professional 
school, to meet all contingencies. All professions arc and should 
be constantly in process of development. In the several Reids of 
psychology which arc applied to educational problems and pro¬ 
cedures, we are dependent upon teachers and other professional 
personnel in the schools not only for the offcotive application of 
psychological facts and principles to the educative process, but 
wo are also dependent upon them for critical and insightful 
observation and assessment of these facts and principles. When 
they have a full appreciation of the work of tlio scientists and 
experimentalists and theorists, they aro also moat effective as 
professional practitioners. 
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Ha-rold E. Jones. Motor Performance and Orowth. Berkeloy: 

University of California Press, 1949, pp. 181. 

This investigation is concerned with the development of 
muscular strength as revealed by semiannual dynamometrio 
measurements of eighty-nine boys and cighty-seven girls from 
age eleven to seventeen and one-half ycQi\s. Although the 
author considers it of little sigaiiicance, it should be noted that 
the occupational distribution of the sample is not representative 
of the general population. There was a marked excess of white- 
collar workers and skilled workmen, and almost none from the 
seniiskilled and unskilled groups. Interpretations, therefore, 
probably should be confined to the present sample rather than 
extended to the general population. 

The reliability coefficients, by a split-test method or by tost 
vs. retest after a week, arc high, i.e,, ranging from .901 to .964. 
Constancy of performance over an interval of six months or 
longer, however, tends to decrease considerably, especially 
for the girls. Thus, over a five-year period, the cocjfiicicnts are 
approximately .00. Maturity factors appear to be involved. 

Cori'clalional analyses of various kiiid.s wore made. Space 
permits citation of only a few of the finding.s: Eor boys the 
correlation of grip atrcngtli with various gross motor abilities 
averaged about .50, but was voiy low for girls. Strength is 
rolalivoly independent of socio-economic faetDrs for the group. 
Among boys there is a slight po.silivc rcliilion l)oLweGn strength 
and social prestige. Examination of various typo.s of growth 
curves and case summaries furnished additional information. 

Educational implications are emphasized. New tasks ‘ ‘ include 
improving the general standards of physical performance, helping 
children svith physical deficiencies lo approach these standards, 
and helping them to make secure and roiili.siic adjustments to 
deficiencioH which cannot be overcome." 

It is probably best lo receive, many of Uiese findings as Icntu- 
tivo and sugge.sLivo rather than firmly established until additional 
studies arc made Avith more representative aamploa. 

MitiUs A. Tinkku 


University of Minnesota 
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Ernest Glen Theory of Hearing. Now York: John 

Wiley & Bonsj Inc., 1949, pp. 441, 

Tho book bcgiua with a prcacnlatioii of nil important classical 
thoorieB on hearing from the beginning of tho Seventeenth Cen¬ 
tury to tho present. At the time of Dr. Wcvei'’a first interest in 
tho theory of hearing, about two decades ago, the two dominant 
thoorioa—the place and frequency theorio.s—wore clinmolrically 
opposed to each other. In collaboration with G. W. Bray, in 
1930, ho discovered the electrical potentials of the car, and his 
teats quickly showed that old and new evidence could be recon¬ 
ciled with both conflicting theories. Continued research by 
olcctro-physiological techniques on the ear’s hcliavior forms the 
basis of liis fusion into a compromise position of llie two theories 
into a new one—the voUcy theory. Each of the older theories 
rests upon substantial ovideuco, but neither by itself is sufllcient. 
Naturally, many problems i*cmuin, and further exUmded investi¬ 
gation is needed. What happens to the peripheral patterns as 
they are transmitted centrally is not yet known in detail. Also 
unsolved is the physical basis of cochlear difTei'niiiiation. How¬ 
ever, further pursuit of the problems can );o carried on more 
comfortably beoauso it is no longer necessary to load the whole 
burden of theory upon moolianioal conditions, and tho frequency 
variable can bo allowed to take its share. 

This is, indeed, a thorough and profound work by Dr. Wever, 
who is Professor of Psychology at Princeton University. There 
is a splendid frontispiece illustration of tlio anatomy of tho 
human, car by the late Max Brddcl, of Hopkins. A twenty-two- 
page bibliography of important roforonccs, four pages of deflni- 
liona and symbols, and a fourteon-page index complete the 
volume. Louis Ciieblock 

Peabody Institute, Baltimore 

Hugh Woodworth. The Nature and Technique of Undersland- 
ing: jSome Fundameniah of Semanlics. Vancouver, B.O.: 
The Wrigley Printing Company, Ltd., 1949, pp. 142. 

Moat of this book is devoted to Oho psychology of conscious- 
ness—tho cognitive aspects particularly. The reader who 
expeota to find a great deal about techniques of understanding 



Booh Reviews 


375 


will be disappointed. The author's avowed aim is to discuss 
meaning and understanding and the technique for attaining 
them. After devoting the first half of Oho book to a discussion 
of topics ranging from consciousness and relation of mind and 
body to feelingSj aensationB and verbal and extended meaning^ 
Woodwortii concludes that understanding is a high degree of 
extended meaning. Extended meaning is dependent upon past 
experience and knowledge, and can be realized only by dwelling 
on a word or Btatemcnt and by exerting effort, whereas verbal 
meaning is the quick, ready and automatic minimum meaning 
evoked, 

The author then classifies experience into dynamic and 
induced experience. Dynamic experience is defined as con¬ 
sciousness produced by the body in action and by the effect 
of the external world vipon tho receptor organs, whereas induced 
experience is the stream of consciousness in reverie and thought. 
The importance of the kinaesfchctic sense in dynamic experience 
is stressed, 

Woodworth finds it necessary to remind tho render in tho 
opening statement of Chapter 8 of this ton-chaptcr book that 
the main topic is still understanding, although ho had to wander 
far afield in laying tho foundation for tlio discussion of this 
topic. This rornarlc gives one some idea of the devious path 
by which the author arrives at the treatment of his main topic. 
Tho author’s tliemc is 'to understand is to experience.' Induced 
experience which approximates or almost duplicates the dynamic 
experience of a thing is the gbsciico of understanding a thing. 
Understanding of things of which one lias had no similar dynamic 
experience is bound to bo weak. The r61o of feelings, freelings 
(the author’s term for feelings accompanying sensations), and 
sensations in experience and understanding is stressed. As 
an illustration of how to employ these in understanding, the 
author suggests that one can understand Ohm’s Law more fully 
by kinacsthotically experiencing the rclatioasliips of the vari¬ 
ables; or, preferably, by identifying oneself with the electric 
cuiTont moving in tho wire and actually experiencing tho circuit, 

Tho author makes a distinction between moaning and under¬ 
standing and roalizfition. Meaning refers to the relatively 
passive associations aroused by a stimulus, whereas understand¬ 
ing and realization involve the organization, of the associations 
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so as to duplicate the experience Avhich is the referent of the 
stimulus. 

On page 12*1 the author finally secs fit to discus-s techniques 
for aiding under.skun<lmg. After examining the factors which 
enter into or delcrinine undcrHlandiiig; namely, cIToctivcness of 
words, range of dynamin exporieiice possessed, inliibitory control 
over nssociation.y sob off, and dogreo to whi(;h ns.sociations can be 
restructured to yichl imluced cxperienc.c tluplie.ating or pavallcl- 
ing the indicated dynamic experience, Woodworth decides that 
the last two factors can he improved and that u wide, hiickground 
of experience cun be cultivated- He suggost-s that a slatomenb 
can be more fully understood by drainutization—l)y acting it 
out. He exhorts all who would increase their understanding to 
cultivate tho dramatist in themselves. He recommends absorb¬ 
ing things slowly, reflecting upon tlicm, and attending to one’s 
sensations nnd emotions as one contemplates, In tljo last 
chapter Woodworth olTors an hypothews, which Bcems dubious 
to tho reviewer, on tho deep rfile of frcelings in underfitnncling. 

Tiio reader of Huh book who possoHses an elementary knowledge 
of psychology will put it down without liaving found a siuglo 
new idea on how to improve understanding. Po.ssibly Nomo 
notions which lie ]ia.s liad for a long time will lie revitalized for a 
time after reading it, lie will have enjoyed roa<ling a well- 
written book on some theoretical topics related to understanding, 
but couched in a somewhat idiosyncratic vocabulary. Tho 
author demonstrates his own skill in communicating ideas to tho 
reader, but fails to give the reader a technique for improving his 
understanding. 

Not a single reference is made to any authority in the fields of 
semantics, psychology, or any other field of learning, in the 
entire book. No bibliography and no reference to any article 
or book appear in this work. Although it is apparent that tho 
author has some acquaintance with tho literatuio of psycliology, 
ho writes as though ho were unaware of its existenco. He gives 
the impression of writing a personal troatmout of hi» subject, 
indopendenb of the body of knowledge available; yet examination 
of the content of this book shows that this is not the case. 

The book is rocommonded to those who would like to vc-ompha- 
size in their thinking tlio psychology of cognition. To those 
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unacquainted with the field of psychology, this book may seem 
provocative. Philip M. Kitay 

Adelphi College 

HERBcuBLii Alt (Chairman) and Othehs, Children Absent from 
School. New York: Citizens’ Committee on Children of 
Now York City, 1949, pp. 116. 

This report, which began as a study of children with records 
of frequent and unexplained non-attondance, is a contribution 
toward the establishment of a comprehensivo cliild-helping 
program in the Ne\Y York City schools. The throe parts of the 
report are concerned with tlie nature of tlio problem of non- 
attendance, tliG bureau of attendance in rolatiou to tlie non- 
attendance problem, and the proposed program of adjustment 
services for the school system. 

The study revealed that most of the childvcn referred to truant 
officers turned out to be lawful absentees, i.e., only fifteen per 
cent were truants. And for these truants, the unlawful absence 
was found to bo only a symiitom of adjustment problems at 
home, at school or within the cluUVa personality. Underlying 
causes are not removed by treating symptoms. These children 
need a kind of help that the hureuu of attendance i.s not qualified 
to give, i.e., to help maladjusted children. Since truancy is one 
among many adjustment prubleins in the school system, the 
report rejects any patchwork improvement of individual bureaus 
and asks for a compi’ohensive plan of adjustment scrvicoH. In 
such a plan, emphasis is placed upon the r61c of the classroom 
teacher who must initially recognize trouble and find help. 
As a now service within the Division of Child Welfare, a school 
counselor is proposed for all schools as a skilled consultant avail¬ 
able to the teacher. Another special bureau in the same Division 
should be empowered to provide help to child or parent when 
needed. Several other recommendations deal with special 
services and organization of the sehool adjustment ]jrogmm. 

This excellent report, although concerned with a particular 
school system, has important implications for other systems. 

Miles A. Tinkich 


University of Minnesota 
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FREDEnicK Mosteiller, ITeiibicrt IIymak, Phillip J. Mc¬ 
Carthy, Eli S. Marks, and David B. Truman with the 

COLLABORATION OP LEONARD W. DOOH, DUNCAN MacUab 

Jn., Frederick F. Stephan, Samuel A. Stouffer and 

S. S. Wilks. The Pre-declion Polls of 10/^8: Report to the 

Conivvillce on Analysis of Pre-dcelion Polls and Forecasts. 

Now York: Social Science Ilcscurch Council, 19*19, pp. 416. 

$2.60 (paper) 

Much that ia inoiaive and much that ia guiT httvS been written 
sinco November, 1948, concerning the prediction failures of the 
varioua pre-clcction poUe. Educators, social scientists and 
atudenta seeking an unbiased and comprehensive account of 
sourcca of error in the foiecast.s can find it in this ljullotin. There 
ia a minimum of diatrilic and a maximum of technical information 
concerning polling practices. Much of this information is pre- 
aontod for the first time in tho literature. 

Immediately following the election, tho Social Science Research 
Council decided to sponsor an nutboritalivo fnidmil inquiry into 
tho polls' dilUoultics. This centralized research, it was hoped, 
would focus attention on tho most pertinent spcijific issues and 
hold down extended controversy over minor points. It would 
avoid duplication of inquiry by many commitlces with a variety 
of sponsors and it would marshal some of tlio best talent in the 
nation as inquiry participants. 

A Committee on Analysis of Prc-clcclion I*olls and Forecasts 
and a technical staff were o-sscmldod by mid-Novomlinr, 1948, 
with a roster resembling a Who's Who in social psycliology and 
survey research. Both national and local polling organizations 
opened their files completely to these inveatigatovs. As a result, 
the Committee was able to releaso a summary report by lato 
December, 1948, based on the detailed findings of tlio teclinical 
staff. The dotaiied staff findings compriao the bulk of this 
bulletin, and tho original committee report is included in the 
appendix. 

Throe early chapters deal with tho objectives and limitations 
of tho bulloLin, with historical matters, and with a proaentation 
of stato-by-stale election results alongside polling predictions. 
Some data from city polls vemus election results also are given. 

Leonard Doob's section on tho public presentation of polling 
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lesults was of particular interefit to the roviewev. Usiiig the 
technique of. comraunicatjons content analysis, Doob is able 
to shed a great deal of light on the problem of whether the polling 
organizations mishandled tlieir public relations and oversold 
themselves and thoii’ services. 

Teohnioal sections on measuring prediction error and on 
sampling techniques will bo of great interest to practitioners and 
serious students of survey methods. A comparison of the 
efficiency of polling predictions to a mere 'persistence forecast' 
is particularly interesting. An excellent job is done in detailing 
quota and pin-point samples as used in 1948. The discussion of 
probability sampling, however, probably will not be sufficient to 
clarify this topic for the non-professional render. 

Questionnaires used by the polling agencies were deficient 
chiefly in theiv comprohensiveness of design. This is considered 
to be a reflection of the rudimentary state of theory in the polling 
field. Available data on interviewer effects is rather meagre 
and often indirect. Precautions taken by major polls to mini¬ 
mize this error source are explained. 

Chapters on processing and adjustment of data, last minute 
swing, and the undecided respondent illustrate liow the polling 
organizations met the sticky problem of making final forecasts 
from their raw data, 

A challenging section on political behavior points out the long 
road which social science must yet travel in formulating adequate 
theory of the behavior of the voter. 

An elaborate appendix section contains tlio Committee Report, 
a complete breakdown of the material on which the Crossley, 
Roper, and Gallup forecasts were made, and additional data from 
the Washington State Poll, the Michigan Survey Research Center 
area sample poll, and the Wasldnglon (D.C.) Post Plebiscite. 

Despite the cautions regarding forecasting engendered by this 
bulletin, the roviewev does not hesitate to predict for it an 
important niclic in tlio suiwcy I'csoarch iitcratuio. Educators 
offering courKc.s in this area will ccrUiiiily find it invaluable as a 
principal or HU])plomenliiry text. Roijeiit L. Jones 

University of Mianosota 
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RELIABILITY, HOMOGENEITY AND NUMBER 
OE CHOICES 

N. L. GAGE and DORA E. DARIRIN* 

Bureau of Research and Service College of Education, 

University of Illinois 

Reliability data are indispensable to any full evaluation of tost 
validity, either for practical purpo^ or for theorizing about 
true relationships between traits. The traits themselves often 
depend, for evidence of their existence, on the demonsti alien 
that they are reliably observable. 

But theorizing about test reliability often goes on in terms of 
mathematical manipulations of statistical concepts that are 
somewhat divorced from reality. Theorists develop assumptions 
and constructs to simplify their formulas but in doing so may 
disregard the psychological data to which their formulas will 
bo applied. This creates the place for empirical studies. How¬ 
ever pat the derivations, we still like to see how the formulas 
work when applied to typical data. Such investigations can 
toll us how close to reality the assumptions and definitions have 
stayed, or how much practical difference their being violated 
actually makes. 

SINGLia-TIlIAI. ESTIMATES OE RELTABIUTY 

Our first major interest was in comparing those estimates of 
reliability that can bo made from single trials. Of the methods, 
wo shall consider only the Spearman-Brown corrected split-half 
cooffioiont (S-B split-half), Guttman's L^, and the Kudor- 
Riclmrdson Cases III and IV (K-R III and K-R IV). Other 
formulas, such aa Rulon's,*' Guttman’s La and Jackson’s 


* Wo have boon helped by many crilicisms and auggeationa from Lo.b J. 
Cronbnch; however, full responsibility for interpretations and conclusions 
rests with ub. 
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sensitivity (gamma)** all reduce to algebraic identities with, 
or mathomatical functions of ono of those (o.g., gamma = 



; hence, they are omitted here. 


Loovingor's estimate 


of homogeneity^^ will also bo considered, although it is not 
intended as an CBlimate of reliability in the URual sonso. Wo 
shall Qxainiuo below the clofiaitionii of oquivalonco involved in 
each of those metliods. 

Spearman-Brown corrected split-half coejjicienla .—Hero the 
single test is split into halves (usually odd- and oven-numbored 
items) and scores on the halves are correlated. The halves are 
assumed to bo equivalent both with ono another and with the 
halves of a hypothetical equivalent form us follows: 


CTfl “ Vfc = = (Till Tah “ TaB =* ToA “ =* TbD — Tao 

whore a and b are halves of iho actual test, A and B are halves 
of a liypothotical equivalent form. 

Using this definition of cquivnlenco wo apply Uio Spearman- 
Brown formula to oslimato tho roliabilily of tho wholo tost, ct -h 
as follows: 

- .... 2rok 

+ + « 

Quitman's h <.—This formula, according to its author, allows 
us to "disponso with assumptions of oquivalonco,”* (p. 275). 
Cronbaoh^ has shown, however, it can bo derived by redefining 
oquivaloneosothatffo+6 = va+a and = rautra^rn = fAbCAOb — 
rbBfThOD - roWTaCt. This rodonnition of cquivnlenco of an actual 
test with a hypothetical ono loads to the ‘lower bound' formula: 

Guttman's crucial assumption is experimental independence of 
items within trials. 

Kuder-liichardson Case 111 .—^Theso writers** dofino equiv¬ 
alence of forms as interchangeability of items i and I, j 
and Jj etc.; the mombors of oach pair have tho same difficulty 
(pi = pif p{ = pjy etc.) and aro corrolatcd to the extent of their 

reliabilities: •• 7 ^1 = = i. Tho intor-item correlations of one 
VruTii 
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test are the same as those in the other (r^/ = Tu, etc.). Since 
straightforward substitution of those equalities, into the formula 
for correlation between the two equivalent forms, leads to a 
need for unobtainable quantities like r«, they make further 
assumptions to achieve a workable formula. Among these are 

(1) that “item and tost measure tho same thing” ^^ 

(2) that all item intercorrelations are equal, thus yielding a 
matrix of inter-itom correlations which has a rank of one (rob “ 
Tac ~ • • • = rrt(„_i)), and (3) that item variances are equal 
(Pd5d = VbQb, etc.). The resulting “formula 20” is: 

n 

where n « number of items 
= variance of test 
‘P = proportion passing each item 
q^l - p 

As Jackson and Foi'guson have pointed out,® (p. 76) tho assump¬ 
tion of equal intcr-item correlations and equal item standard 
deviations imposes a further requirement, unstated by Kuder 
and Uicharclson, that the items be equal or at most of two levels 
in difricuUy. Loovinger has concluded that the method therefore 
“applies only to a case of no importance,” since complete satis¬ 
faction of these assumptions leads to “a test on which everyone 
scored either zero or perfect,”*® (p. 11). The coefficient is 
defensible however since its authors point out that “if the 
assumptions arc not met, the figures obtained are under-esti¬ 
mates,”" (p. 159). 

Knder-Richardson Case IV .—The formula in this case is 

n — nv 7 
= ~i ■ -\r- 

. Moan of the test scores 

where f) =* -;-and q = 1 — p. 

fv 

Here the aasumption.s arc the same as for Case III witli tho 
addition tliat all items arc explicitly us-sumed to have the same 
difficulty. Since tliis assumption is implicitly made in Case III, 
as mentioned above, this formula represents merely, as Loevinger 
puts it,’® (p. 13), “carrying one atop further the consequences 
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of asBuming items of identical difficulty." Estimates by K-RIV 
have some merit in that the economy of effort in computing them 
counterbalances the still greater underestimation obtained as 
compared with K-U III. But their assumption of equal diffi¬ 
culty implies that they will lead to relatively inaccurate esti¬ 
mates of reliability for tests intentionally mado to have items 
with tt wide range of difficulty. 

The Concept of Homogeneity. —Loovinger” has designed a 
formula to express a property of testa winch is somowliat difforont 
from that approached by tho above formulas and which she 
calls ‘homogeneity.^ This is tho degree to which all items of a 
test measure tlie same ability or complex of abilities for all 
individuals tested. A necessary (but not sufficient) condition 
of perfect homogeneity is that all persons succeeding with items 
at one level of difficulty should also succeed witli all items at 
lower levels of difficulty. Similarly "when the ilcms of a per¬ 
fectly homogeneous test are arranged in order of increasing 
difficulty, every individual will pa® all items up to a certain 
point and fail all eubaequont items,”*® (p. 28). Subsequently*^ 
Loevinger pointed out that these requirements apply in this 
form only to wlmt she has denoted 'cumulative' os against 
'difTorential' homogeneous tests. 

CharactoriBtics of tests which are closely related to Loovinger’s 
'homogeneity' have frequently been discussed by others using 
Buch terms as coherence,*® and unidimensionality or scala¬ 
bility.® Perhaps tho first consideration of this characteristic 
was by Walker,*® who in 1931 described a property of tests 
which ho called 'higgledy-pigglcdyness.' To measure this 
property, Walker developed a ‘coefficient of hig'*° which he 
later®* found of dubious merit. 

In 1937, Newcomb verbally described tho samo characteristic 
of cumulative 'homogoneoua' testa as applying to attitude sealoB: 
"No scale can really bo called a scale unless one can tell from a 
given attitude that an individual will maintain every attitude 
falling to tho right or to the loft of that point (depending on liow 
tho scale is constructed)/'*“ (p. 897). 

In 1941, Ferguson,® (p, 64) stated that "at present no con¬ 
venient quantitative moasure is available for estimating tlio 
divergence of an obtained answoi^pattorn matrix from a theo¬ 
retically unique matrix." Later,® (p. 6G) ho describes a measure 
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of homogeneity which is equivalent, in Loevinger’s terms, to the 
variance of the test divided by the variance of a perfectly homo¬ 
geneous test v/ith the same item diffioulties. 

Loevinger's.index is an attempt at rational quantification of the 
concept. We shall examine its relationship to the concepts of 
‘reliability’ embodied in the other operational definitions con¬ 
sidered here. Her 'homogeneity’ purports to be not another 
type of ‘reliability’ coefficient but a partial alternative to it. 
Her index relegates to error variance all of the following: group 
factor variance, specific factor variance, and errors of measure¬ 
ment of items. This means that a perfectly homogeneous test 
is one whose entire variance is entirely attributable either to a 
single general factor, or to “an approximately constantly 
weighted sum of factors,”^® (p. 622). 

Loevinger points out that her index of homogeneity is only 
one of many possible ways of estimating this property of tests. 
Its sampling properties ai-e as yet unknown. Wo have studied it 
here because no empirical studies of the index have yet appeared. 
Our assumption is that the intcrpretability of the statistic will bo 
enhanced by a knowledge of how it varies with number of choices 
and test length, and of how its size compares with the coefficients 
yielded by single-trial estimates of ‘reliability.’ 

Since the estimate of homogeneity, 


est lit = 


Vx - Vk^i 
Vkom ““ ^hel 


where 7, = Variance of the test, 

Vh,i = Variance of a perfectly heterogeneous test with the 
given item difficulties, 

Vhom = Variance of a perfectly homogeneous teat with the 
given item difficulties, 

it should be noted that it dilTers from K-R III by the omission of 

7Z' 

the-r term, and in the denominator. In Loevinger’a terras, 

71 -L 


K-R III = 

n — I 



TEST nELIADILITY AND NUMBER OP CHOICES 

The second major problem at which this study is aimed is the 
relationship between single-trial estimates of reliability and 
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number of choices per test Hem. It has long been realized that 
come of the error variance in muitiple-cboicc tests of ability 
ariaea from cKwicq auccesa in chooHing tho correct alternative 
from those furnielied in each tost item. It should follow that 
incrooacd test reliai)ility will result from an increase in the 
number of functioning (in the sense of increasing the r between 
correct clioico and total score) choices per test item. 

The Spcarman-Broion ronnufa.—^'I'liis hypothesis has already 
been investigated in a series of fitudics by Ilommors and his 
co-workers. Three of tliesc atudics'-**’ arc pertinent licrc since 
they involved especially-designed experiments using ability 
testa in which cacli item is scored zero or one. In tlicso aludies 
Remmers investigated w!\clUcr the cliangcd reliability could be 
predicted by moans of tho Spearmnn-Brown formula, with 
change in test length conceived as the ratio of now number 
of choices per item to old. 

In tlioir studies it is evidout that the sets of four reliability 
coeflioients, although tiicy did not differ signilicantly (in terms 
of critical ratios) from tho Spearman-Brown predictions, did 
not in all eases follow a curve ehnllar to that obtained liy pre¬ 
dicting with tho Spearman-Brown formula from tl>o two-choico 
form. This is especially true of House’s data, in which tho 
four-choico form was much more vclialdc tlian tho Spearman- 
Brown formula predicted and tho five-choice form showed 
almost no increase in reliability over the four-choico form. These 
discrepancies indicate the desirability of further investigation. 

Two rofinomonts of experimental procedure could bo introduced 
to eliminate certain possible sources of the observed discrepancies 
between actual and predicted ‘rcUability’ coefTicionts. Tho first 
is controlled rather than random elimination of misleads to 
convert five-choico items into four-, three-, and two-choice 
items. The second is administration of a 'control* test that 
would be the same for all groups, thus making possiide empirical 
verification of the groups’ comparability on the experimental 
forms and adjustment of tho obtained coollicicnts for dilTorcnccs 
in the 'range of talent’ of tho groups. Those refinements are 
further described below, 

Lord’s Formulo.—Sinco tho Spearman-Brown formula was 
originally developed to express tho correlation between sums and 
differences, one cannot assume its rclation to the correlation 
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between forms of a test differing only in number of choices per 
item. Lord^^ objected to its use in this way on the ground 
that items cannot be made perfectly reliable simply by adding 
choices, and the Spearman-Brown formula does not take into 
account the difficulty of the teat. 

Lord has sought to avoid these difficulties by deriving an 
adaptation of the Spearman-Brown formula. Assumed in his 
derivation are (1) equal inter-item correlations (four-fold point 
r’s), (2) equal item difficulties, (3) equal plausibility of choices 
within each item to individuals not knowing the correct answer, 
(4) answers to all items by all individuals, and (5) values of 0 or 1 
for the choices in each item. 

It can be objected that the assumptions of neither the Lord 
nor the Spearman-Brown formula will ever be met by actual 
test situations. It is nonetheless relevant to the evaluation of 
them, and to the theory underlying their development, to deter¬ 
mine which more closely predicts the changes in reliability found 
empirically when'clianges in number of choices are introduced 
into a given test. 

PnOCBDURE 

Our procedure in investigating the two major questions out¬ 
lined above may bo described in terms of (1) the test used, (2) the 
subjects tested, and (3) the administration of the tests. 

The Test and Its Fowis .—In choosing the test to be used, wg had 
several considerations in mind. The test should be fairly homo¬ 
geneous in content so that application of ICudcr-HiohardBon 
formulas would be not altogether unjustified. It should be well- 
refined in terms of the discriminatory power and difficulty of 
its items and their misleads, so that we could have some assurance 
that all items and misleads were functioning. There should be 
adequate data on the difficulty and discriminatory power of the 
items and misleads so that some empirical basis could bo used 
in the construction of the various forms. It should bo a power 
test rather than a speed tost since these formulas render spurious 
estimates of ru for speed tests. It should bo an ability test 
rather than a non-intcllcctivc lest so that fclic assumptions of 
certain of the formulas to be applied would be met. It should 
be applicable over a fairly wide range of ability so that students 
in both high-school and college classes could be tested. Finally, 
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the Bcorca obtained should have some promiso of usefulness to 
the Goftperating teachers and students to repay them for their 
time and effort. 

The teat selected as meeting all these reciviircmenta was the 
Ohio State University Psychological Test, Form 21, which has 
been developed and renned over many years by II. A. Toopa 
and his collaborators, Of the one liundrod fifty items only the 
first ninety, comprising Parts 1 and 2, wore used. Tho first part 
consists of thirty same-opposite vocabulary quosliona illustrated 
by the following: 

Littlo is tho SAME AS 1 coarse 2 small 3 prodigious 

4 immense 5 feeble 

The second part consists of sixty verbal analogies of tlic following 
kind; 

boyiboys: iman: 

1 girls 2 men 3 man's 4 men’s 6 gontlomon 

These 90 items w'cre arranged in order of difiiculty on tho basis 
of item analysis data.'*** The odd-numbered items, afLor this 
rearrangement, were designated 'control’ items; tlioy were left 
unchanged and wore administered in the earao form to all subjects. 
These 'control’ items wore intended to provide a means of 
verifying the comparability of tho groups of subjects that wore 
tested with 'experimental* items described below. 

The even-numbered items were treated as the 'experimental’ 
test by having their number of choices varied. Four forms of 
this test were made as follows: Form 5 consisted of tho even- 
numbered items with five choices, i.o., intact, as in tlie original 
test developed by Toops. Form 4 consisted of the same items 
with one of the false choices eliminated; thus each of the Form 4 
items had only four choices. Form 3 similarly had only three 
choices per item, i.e., two of the four original false choicea were 
eliminated. Finally Form 2 had only two choices per item, 
three of the original four false choices having been eliminated. 

Tho dropping of false choices to make Forms 4, 3, and 2 was 
done in terms of tho item analysis data furnisiicd by Toops. 

* Wo ftpo grateful to Professor Toops for lus permission to use tins test 
and tor tho item analysis data, based on 1,000 Ohio Stato University trosh- 
mon, whiuh he supplied. 
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To make Form 4, the experimental items were arranged in order 
of difficulty. The items were then put into four groups, every 
fourth item going into the same group. The distributions of the 
item-test validity coefficients for these four groups were com¬ 
pared and found to be similar. From the first of these groups, 
the moat popular mislead was eliminated; from the second group, 
the second most popular mislead was eliminated, etc. 

To make Form 3, the same procedure was used except that 
only three groups of items, roughly matched on difficulty and 
validity, were formed. Of the remaining three misleads, the 
most plausible was dropped from the first group of items; the 
second most plausible, from the second group; etc. Form 2 
was made by a repetition of this procedure after the items had 
been divided into two groups. 

This procedure gave us some assurance that the forms would 
not differ sharply in respects other than the number of choices. 
The plausibility of the eliminated choices and hence of those 
remaining was controlled to produce a more representative 
manipulation of the items than chance alone might have yielded. 

The Subjects. —Approximately one thousand high-school and 
college atuclonta wore tested.* The high-school students wore 
the entire eleventh and twelfth grade claascs of three high sohools, 
of which two were predominantly urban and the third mainly 
rural. The college students were for the most part sophomores 
and junior.s enrolled in various sections of an introductory 
educational psychology course. Of those obtained, only the 
nine hundred seventeen answer sheets were used in subsequent 
analyses which had one and only one answer to every item. 

Administration of the Tests. —The students were directed to 
proceed through the questions in the order given, to attempt 
every question, and to guess if necessary. These instructions 
were intended to eliminate individual differences in 'willingness 
to guess’ as a possible non-intclloctual factor affecting scores 
and, in ciTect, made the test more constant for all subjects. 
Furthermore, the 40-minute time limit proved sufficiont to 
allow more than ninety per cent of the subjects to attempt all 

* For pormisHion to test thoir students, wo aro grateful to Mr. James K. 
Felts, Monticello H.S.; Miss Sally Fialior, Urbana H.S.; Miss Vera Kndon, 
Champaign H.S.; Professors W, U. Dixon, Ray Simpson and Graham Pogue, 
University of Illinois. 
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itoma. Since the Luoompictc answct aliccta were elimmated from 
the BtfttisticQl auftlysia, the results are based on what was essen¬ 
tially an unspeeded, power teat for all subjects. 

The tests were distributed to the students in rotated order so 
that the first student in any room received Form 6, fclie second 
Form 4, etc. Tliis mechanically rotated distribution was 
intended to yield random selection of aludents, and lienee com¬ 
parable groups, for each form. Scores on the 'control’ items 
provided a means of ascertaining, and slnlistically adjusting for, 
such dissimilarity between these groups as still appeared. 

RESULTS 

Four scores (number right) were obtained for each student. 
Score 1 was based on the forty-five odd-numbered 'control' 
items. Score 2 ^Yas based on tho forty-live even-numbered 
'experimental' items, which differed from form to form in number 
of choices. Scores 3 and 4 wore based on odd and even halves 
of tho ‘experimental' items, respectively, to provide data for 
computing those reliability catimatCH (corrected apUt-haU and 
Guttman’s 1^4) which require aplilting tho to.st. 

'Control' Test ResuUs.—Table 1 shows tho moans and standard 
deviations of tho 'control' scores of the four groups. Also given 
arc tho means and standard deviations of the scores on tho 'experi¬ 
mental' items, 

These figures show that the mean scores on the control items 
did not differ markedly from one group to another. Indeed, 
as tho F-ratios of the analysis of variance indicate, the ' between 
groups' variance for the total group, far from being significanlly 
large, is significantly smaller than chance would allow. This 
merely reflects the wide range of talent tested and tlio efficiency 
of the rotated distribution of forms in securing similar groups. 

As is to be expected, the mean scores on the experimental forms 
decrease regularly (except for tho college students on Form 5) 
from Form 2 to Form 6, The forms increased in difficulty (or 
decreased in susceptibility to chanco succesa and to bucooss 
through partial knowledge) as the number of clioiccs incre/ifiocl. 
Since wo wished in any ease to make adjustmonU in tho roU- 
ability estimates for aiich variations in 'range of talent,' wo did 
not apply teats of significance to the diffcrcncce among standard 
deviations of the four ‘form-gtoups’ on the control items. 
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Table 1.—Means and Standard Deviations on 'Contbol* 

AND ‘EbcPERIMBNTAI.^ ITEMS 

Results of Analysis 
Total Group of Variance Be- 


Test 

Control 

Control 

Exper. 

Exper. 

tween Groups on 

Form N 

M 

SD 

M 

SD 

Control Items 

2 

241 

18.32 

10.20 

30.06 

7.65 


3 

223 

19.24 

10.03 

24.65 

9.12 


4 

228 

18.33 

10.52 

21.23 

10.49 

F = .02, p > .05 

6 

225 

18.66 

10.25 

19.23 

10.40 





EEigh-scliool Juniors 


2 

84 

13.26 

6.66 

26.73 

5.76 


3 

SO 

13.05 

6.35 

20.62 

7.33 


4 

85 

13.33 

7.96 

16.67 

8.80 

F = 1.81, p > .05 

6 

84 

15.35 

7.80 

16.89 

7.93 





High-school Seniors 


2 

96 

16.48 

7.89 

28.60 

6.96 


3 

81 

16.99 

8.00 

22.59 

8.20 


4 

82 

16.46 

9.50 

19.68 

10.07 

F = .70, p > ,05 

6 

87 

14.97 

7.97 

16.79 

8.95 





College Students 


2 

61 

29.74 

8.63 

36.93 

6.17 


3 

62 

27.87 

9.60 

32.16 

7.71 


4 

61 

27.82 

8.03 

29.67 

7.98 

F = .70, p > .05 

5 

64 

29.37 

9.27 

29.96 

8.62 



Com'parisons of ‘Reliability* Formulas .—In Table 2 are given 
the various coefficients obtained on the ‘experimental' test. 
On the left-hand side are the coefficients actually obtained; 
on the right are the coefficients adjusted to constant variability, 
or ‘range of talent.' The standard deviation of the Form 2 
group on the control items was used as the ‘anchor’ to which tho 
reliabilities of the experimental forms taken by the other groups 
were adjusted. In comparing the adjusted cocfTicients sliown in 
Table 2, we can sec that (1) tlic Spoarmmi-Brown corrected odd- 
even cooflicients avo all slightly larger than those obtained by 
Guttman’s L^, (2) tho K-R III coefficients arc all larger than 
those obtained by K-R IV, (3) the Spearman-Brown corrected 
ocld-evon coefficients are larger than those by K-R III except 
for Form 5, (4) tho K-R III coefficients are not consisLontly 
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Table ^.—Coefficients of 'Ubwabiuty' fob tub Four 

FxPERltfBNTAL ForMS 
Totnl Group 



Obtoined 

Adjusted for Variability 
on Control Tost 


Spear- 




HI 


m 



man- 


Kuder- 

Kuder- 




Kuder- 

1' orm 

Brown 

Gutt- 

Rich- 

Rich- 


Gutt- 


Rich- 


Cor- 

man 

nrdson 

ardson 

Cor- 

man 

ardson 

ni'claon 


rooted 

U 

Cfiso 

Ooso 

reeled 

L, 

Case 

Case 


Odd- 


m 

IV 

Odd- 


III 

IV 


even 




even 




2 


.858 


,844 

m 

.868 

.SG3 

.844 

3 


.901 


.886 


.904 

.902 

.890 

4 


.029 

.028 

M]||| 

.030 

.026 

.023 

.013 

6 

.920 

.923 


IQJ 

.026 

.922 

.927 

.917 


High-school Juniors 


2 

,797 


,737 


.797 

.796 

.737 

.688 

3 

,864 

.852 

.831 


.807 

.866 

.840 

.827 

4 

,901 


.898 

.884 

in 

.858 

.855 

.835 

6 

.866 

.864 

,870 

.866 

m 

.800 

.822 

.801 


Higli-school SonioiR 


2 

.814 

.814 

.828 

H 

.814 

.814 

.828 

.803 

3 

.869 

.867 

.871 


.865 

.803 

.808 

.848 

4 

.918 

.011 

.920 

.911 

.881 

.871 i 

.884 

.871 

6 

.909 

.007 

.906 

.892 

1 

.907 

.005 i 

.903 

.890 


Oollogc Students 


2 

' .869 

.840 ; 

,886 

.846 


.846 

.866 

.846 

3 


.890 ' 

.886 

.805 


.804 

.869 

,833 

4 

' .011 

.000 

.886 

.800 


.000 1 

.886 

,800 

6 

.003 

.893 

.006 

.883 

.888 

.877 

.891 

,864 
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related to the L 4 ’ 9 , being slightly larger in two cases and slightly 
smaller in two. 

The results shown in Table 2 do more than provide an empirical 
demonstration of known mathematical relationships between the 
several formulas. Of practical importance to the test-user in 
any field is the magnitude of the differences between various 
kinds of estimates of reliability. It will be noted that for a 
test of this type the ‘underestimate' yielded by Guttman's L 4 
is so slight as to be unimportant in practice. Likewise, the 
differences between the two types of K-R coefficients are, for 
most practical purposes, not of sufficient siae to justify the extra 
labor involved in the computation of K-R III. The latter 
finding is especially interesting in view of the wide variation 
in the difficulty of these test items. 

Although the estimates obtained by tho split-half procedure 
are for tho most part higher than those by tho K-R formulas, 
this in no way establishes the superiority of this method. Such 
a finding is tho result of chance, for the size of the coefficient 
obtained for any specific split is a function of the ratio of the sum 
of the half-test covariances to tho intcr-lialf covariances. If 
our split happens to be such os to maximize the within-half 
covariance terms and rainimiire those between halves, our 
coefficient will be lowif tho roverso occurs the coefficient will be 
appreciably higher. 

Comparison of Forms Differing in Number of Choices .—If tho 
adjusted coefficients shown in Table 2 are compared from form 
to form, it is seen that they riso regularly from Form 2 (two- 
choice) to Form 4 for tho total group. In two of the coefficients 
(S-B odd-oven, and L 4 ) there is a slight drop in Form 5 from Form 
4 while in tho other two (K-R III and K-R IV) there is a slight 
continued riso from Form 4 to Form 6 . In the subgroups by 
educational level, the trends are not so regular. Among the 
high-sohool juniors, tho split-half coefficients (S-B odd-oven and 
L 4 ) are highest for Form 3 while the IC-R III and IV are highest 
for Form 4. Among the high-school seniors, all coefficients 
regularly increase from Form 2 to 5. Among tho college students, 
the peak is hit at Form 4 for the split-half coefiicionta and at 
Form 6 for tho IC-R’a. 

How are these trends to be interpreted? In the first place, the 
general hypothesis that reliability increases as number of choices 
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18 InGreased tends to bo supported by those data. When it is 
romcrabared that the K-R cooHicionts are unique estimates and 
depend in no way on judgment or chance in teat-splitting, con¬ 
fidence in Ljie hypothesis is further bolstered. Tims, the failure 
of the Form 5 .split-luilf coeffieiente to sliow continued increase 
over Form 4 merely reflects ‘had luck’ in aiilitting tlii-a teat into 
equivalent )mlvo.y. 

Secondly, the level of ability of the group tested may be related 
to the number of choices at which inaximinn roliability is obtained. 
The fact that the highest K-R coeflicicnla appear at Form 4 for 
high-school juniors but at Form 6 for both high-school seniors 
and college students indicates that the addition of choices may 
indeed lower roliability by increasing the difficulty of the test 
beyond the optimal point for the level of ability of llic group. 

Comparison of herd and Spcarman-lhown Formulas .—AVc have 
already described the two formulas that have been auggesled for 
predicting change in Lest reliabilily with change in number of 
choices per test item. We shall evaluate lliem in terms of how 
closely their predictions accord with our adjustinl K-ll III 
coolTicicnta. 

Figure 1 shows tho adjvsaVcd for ail Hludonta \>y tiio 

K-R III formvila, and those predicted from Forma 2, 3, and 4 
by the SpeaYman-Rvown and TiOvd form\di\9. 

In predicting from Form 2, Uio fipcarmau-Brown is moro 
accLirato than Lord’s formula. This is especially true of the 
predictions to Formg 3 and 4 from Form 2. 

In predicting from Form 3 to Forms 4 and 5, howovor, the 
two fo]mula.s yielded tlie same estimab) for Form 4 and Lord's 
formula was slightly more oocuraio for Forjn 6. 

Finally, in predicting from Form 4 to Form 6, the Lord formula 
was slightly more accurate. Thus neitlior formula emerges 
wdtli a clear-cut suporiority. 

We offer no rationalization for tlio failure of Lord’s formula, 
especially derived for the use hero made of it, to predict changes 
in reliability moro closely than the Spcarnian-Browii formula. 
It is evident that Lord’s assumptions are not mot by our teat. 
Nor would they bo much moro closely np]>ro.\imat(id by any 
mental ability test now in use. It ia lempLing therefore to 
ascribe its comparative failure to its unroaliatic assumptioiLS. 

But the use of the Spearman-Brown formula is also vulnerable 
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NUMBER OF CHOICES NUMBER OF CHOICES 

PREDICTION FROM FORM Z PREDICTION FROM FORM ^ 

-OBTAWEO K-REI^CORR, FOR RANGE OF TALENT) 

_SPEARMAN-BROWN PREOICTION 

..LORO PREOIGTiON 

Figure 1, ObtaiucJ and Prudietwl Kudoi-lUohwdjvon Case III CocfficientB 
fcr Di^cront Numbcts of C.;i}ioi&c&. 
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Bmco it not doTivccl Jor the \i80 heto made of it and since no 
rationale for its relative success hw yet been ofTered. In increas¬ 
ing number of choices, wo seem to do notliing strictly analogous 
to increasing number of items, number of minutes, or number of 
judges, to all of which the Spearman-Brown should and does 
apply. Yet the fact remains that when a two-choice teat is 
changed to a Ihrcc-choico or a four-choice test, wo obtain reli¬ 
ability estimates very similar to those we would got if wo had 
multiplied the number of items by 1.5 or by 2. 

Tho practical Bvgnificancc of these findings for test builders is 
tliat test' reliability' can be increased afl predictably by increasing 
number of choices os by increasing number of items. If tho 
author of a fifty-item two-choice lest finds it has a reliability, 
by any of tho formulas, of say .82, and wishes to increase this 
figure to, say, .90, ho can choose between writing another fifty 
two-choice items, maKimally equivalent to those already written, 
or writing an additional two valid choices for each already 
written item. 

Tho difficulty and validity of the choices added would need 
to bo carefully considered since they might add nothing if they 
were less plausible and valid than the elioicos already present 
in tho items. But similar considerations would apply to what¬ 
ever new items miglit be added. The decision between these 
paths bo higher reliability might then depend on whether it was 
more feasible to add choicos or to add items witliout changing 
the factorial composition of the test. 

Loemnyer'e llomogenoil/y Formwlo.—To throw light on its 
behavior with a test of tlio kind for whicli it was designed (a 
power test of ability) wo have computed Est Hi for our various 
forms. 

Tho values of Est Ht (unadjusted for range of talent) in Table 4 
show that this statistic increased in size as the number of choices 
increased, up to four choicea, juat aa did tho unadjusted K-ll III 
reliability estimates. This suggests that, as the error of inoasuro- 
mont of tho individual itoms was dooroaaed, a greater proportion 
of tho total variance went into the general factor vavianeo of tho 
tost. 

But Eat Hi did not increase regularly as the number of items 
increased from twenty-tm U> forly-five to ninety, for Form 5. Thus 
Eat Hf increased from .266 to ,311 for tho change from twenty-two 
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to forty-five items (Set A) but decreased from .311 to .307 for 
ninety items. IC-R III on the other hand, increased regularly 
from twenty-two to ninety items. (It is noteworthy in passing 
that the changes in K-R III values from that for twenty-two 
items to those for forty-five and ninety items aro in very close 
accordance with Spearman-Brown formula.) 

Tadlb 4.— Values of Loevingbii's Est Hi and IC-R Case III 
(Not Corrected for Range of Talent) for Tests- 
Differing in Number of Choices per Item, and in 
Number of Items per Test 


Type of Test 

Loevinger’a 
Est Hi 

K-R 
Case III 

46-item, 2-choice 

.182 

.863 

46-item, 3-choicG 

.229 

.898 

45-item, 4-choice 

.311 

.928 

45-item, 5-choice 

.311 

.928 

22 -item, S-choice 

.265 

.843 

46-item, 6-choice (A) 

.311 

.928 

46-item, 6-choico (B) 

.302 

.926 

OO-item, 5-ohoioo (A 4* B) 

.307 

.962 

When the Kudcr-Richardson 

coefficient and 

Loevinger’s 


homogeneity index are computed on the other half (B) of the 
ninety-item test, the two estimates do increase together. This 
indicates that while Est Th and K-R III need not vary together, 
it is possible for them to do so. Furthermore tlic nuraorical 
values of Est Hi are much loAvcr than those of the ‘reliability’ 
coefficients for the same tests. 

These results show that, although proposed as a ‘partial altor- 
native' to reliability, homogeneity does not reflect increased test 
length as reliability ostirantca do. This is perhaps understand¬ 
able in that homogeneity depends on the persons’ consistency in 
(1) failing all items requiring ability beyond a point of maximum 
difficulty and (2) passing all items below that point. If, as the 
number of items increases, the difTcrcnccs in difficulty between 
items become smaller, such consistent behavior becomes leas 
probable, and the values of H would decrease. It follows that, 
of two tests differing only in their distributions of item difficulty, 
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the ono with the greater variability in item dilHculty should 
yield the higher //. 

Wc have looked into this posHibilily l)y computing //, for 
two seta of nineteen items from our nve-clioice form. The 
distributions of difllculty (p) of the two sots difTcred as shown 
below: 


Difriciilly 

Number of Items 


Set A 

Sot B 

.GO-.00 

3 


.60-.69 

3 


.40-.49 

3 

10 

.30-.39 

3 

9 

.20-.29 

3 


.10-. 19 

3 


.01“.09 

1 


‘Total items 

19 

19 

No. of coses 

226 

226 

Mean 

7.38 

7.04 

S. D. 

4,47 

5.14 

Esb. lit 

.345 

.310 


The dilTeronce in IIi between Sets A and B, although apparently 
not groat, is in the predicted direction. In the absence of 
sampling statistics for /fi, wo have, of course, no adoquato way 
of judging the significanca of this difTovGnee. 

It is evident that II^ although it has limits of zero and unity for 
I)QrfGct hotorogeneity and homogeneity, mepeclively, docs not 
have the same interpretabilily as do rcliability coefficients. lU 
was much lower than for a given test. How high Hi should 
be to indicate a ‘high’ degree of homogeneity wo liav'O as yet 
no way of knowing. What is needed is some kind of 'norms,' 
arrived at either empirically or tlirough derivation of the ‘stand¬ 
ard error' of IIi, which will give ua a ba.sis for inlcrprcLiiig values 
of Hi. 

SUMMATIY 

1) This research deals with two problems: (1) differences 
between single-trial estimates of reliability and homogeneity, 
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and ( 2 ) differences between two formulas for predicting change 
in reliability with changes in number of choices per test item. 

2) The procedure was to administer four forms of Parts 1 
and 2 of the O. S. U. Psychological Test, the forms dilTering in 
number of choices per test item, to four groups of high-school 
and college students. Values of the corrected odd-even, Gutt- 
man L 4 , ICuder-Richardson Cose III and Case IV, and Loevinger 
homogeneity statistics were computed from the resulting data. 
Adjustments were made for range of talent to make the reliability 
estimates comparable from form to form; controlled rather 
than random elimination of choices was used to make the various 
forms. 

3) The differences between the obtained single-trial estimates 
of reliability were in the directions expected from analyses of the 
derivations of tlie formulas. More importantly, the differences 
hero obtained with a fairly typical power test of ability were too 
small in size to be of practical signiAcance. 

4) Tho differences between the formulas (Lord and Spearman- 
Brown) for predicting change in reliability with number of 
choices did not clearly indicate tho superiority of either. The 
accuracy of both compared favorably with tliat of tho Spearman- 
Brown when applied to number of items. 

6 ) The Loevinger homogeneity index increased as did tho 
reliability estimates as number of choices was increased. Its 
numerical value was much smaller than that of the reliability 
coefficients. There was no basis for judging the psychometric 
or statistical significance of the values obtained. That is, did 
they indicate a relatively heterogeneous or homogeneous test? 
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GROUP GUIDANCE IN THE PROGRAM OF A 
READING LABORATORY 

GLADYS L. PERSONS and MARY H. GRUMBLY 
Univoraity of Bridgeport, Bridgeport, Conn. 

The purpose of a reading laboratory or clinic is the rehabilita¬ 
tion of retarded students in. skills of reading, study habits, self- 
confidence and personal development. Naturally, guidance 
should play a large part in this program. At the Laboratory of 
the University of Bridgeport, such a program has been initiated. 
The procedures and results will be discussed in this article. 

Of the twelve principles and practices of Guidance as set 
forth by Cox, Duff and McNamara, it is apparent that six are 
fundamental to the philosophy of a reading laboratory and are 
in effect in varying degrees according to the size and duties of 
the staff. These six principles of guidance are;* 

1 ) Guidance consists in helping pupils to set up objectives 
that are for them dynamic, reasonable, and worth >Yhile, and 
in helping them, so far as possible, to attain these objectives. 

2) The major fields in which guidance is necessary are health, 
vocation, avocation, education, and human relations. 

3) The idea of guidance is inhorent in all efforts to educate. 

4) The kind and amount of guidance needed varies greatly 
with different children and in different situations and at different 
times. 

6 ) A research and measurement program is an essential part 
of successful guidance work. 

6 ) The proper adaptation of curriculum and method to the 
needs of individual pupils is best promoted through guidance 
activities of teachers working in a democratically organized 
school system. 

That these principles are in operation in the Reading Labora¬ 
tory of the University of Bridgeport is evidenced by the impor¬ 
tance placed on the case history in the diagnosis, the conferences 
with one or both parents, conferences with school principals and 
guidance directors and the eager acceptanco of all school records 
and records of previous tests. It is apparent, too, in the testing 

* Cox, Duff and McNamara. Basic Princvples of Outdance, Now York; 
Prcntice-Hall, Inc., 1948. Quoted by permission of the Publishers. 
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which precedes instruction of each and every student. The 
foilowing tests are administered (forma of some being adapted 
to age and achievement of individual tested): 


Tost 

1) Stanford-IMnet or Wechalcr- 
Bollovuo Tost of Mental 
Ability 

2 ) Braw-a-Peraon 

3) Iowa »Silent Heading or Stan¬ 
ford Silent Heading or Gates 
Primary or Heading Readi¬ 
ness 

4) Vocabulary—Inglis 

5) Standardized Spelling 

0) Telobinocular—a screening 
test of vision 

7) Gray Oral Check 

8 ) Dominance 

9) Ophthalmograph 

10) Achievement Tost in com¬ 
mon school subjects 


Purpose of tlio Test 

to dctcvmino intnlligoneo quo¬ 
tient and to gain insight 
into personality 
to gain additional insight into 
personality 

to determine the silent read¬ 
ing level 

to dclormino word knowledge 
to dotcrmitio ability to spell 
and obvious causes of 
Hpelling dinieidlies 
to refer to an oi)ljthalmologibt 
if rcHulls are unsatiB- 
factory 

to determine the level of oral 
reading and types of 
errors 

to determine if left-sidcdncss 
or mixed dominance is 
prosont 

to get a picture of eye move¬ 
ments during reading and 
of rate of reading 
to study growth and acbiovc- 
ment of individual 


Once the child has been accepted as a abuclont, there ia an 
attempt to see that his health and porsonaUty needs arc mot. 
There aro interviews with doctors, oyo and car 8])cciaHsts and 
paychiatrials; contact is made with any and all wlio have l)ccn 
ministering to the child. Efforts aro made to develop apparent 
talents and to nourish aggressive tendencies whore only self- 
diatruat and timidity exist. Instruction is planned to meet 
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individual needs and re-testing at intervals to measure gains 
takes the place of subject-matter examinations and reports. 

In order to meet individual needs in instruction, students are 
grouped according to their reading level and, whenever possible, 
according to their stage of physical and social growth. Because 
all students have .some history of retardation before coining to 
the Reading Laboratory, them are no students below the age of 
eight and seldom any above the age of twenty in the morning or 
what is known as the full-time session. Student groups vary in 
number from one to eight or ten; they work with materials of 
interest to their age and of difficulty suitable to their reading 
level. 

One typical group is that of five twelve-year old boys who have 
advanced in regular school os far as Grade IV but because of 
reading disability have little hope of going ahead. They are, 
therefore, in the Reading Laboratory. Two of them have 
better than average intelligence quotients; two are average. 
One is probably a mental defective whose personality makes up 
for much. (Those dealing with this student feel that once skills 
of reading are acquired, liis placement in. the intelligence test 
may be changed.) These boys are talking about vocational 
plans already and evince interest in occupations and their own 
capacity for profiting by training in certain vocational fields. 

Every reading laboratoi’y has a group of adolescent boys who 
were pushed through grade school and who then realized with 
a shock (as did their parents) that they were not prepared for 
high school even though they had been handed a grade-school 
diploma. Such sixlcen-year-olds have constantly in mind the 
importance of preparing to earn a living. In addition to develop¬ 
ing reading skills, they want to know what fields they may hope 
to enter, where they may.obtain training for the vocation of 
their choice, and what the educational requirements are, 

A typical evening group of students in the Reading Laboratory 
is compo.sed of young working men who hope for advancement in 
their places of employment or who hope to take advanced courses 
which will lead them into other fields of work, both more interest¬ 
ing and more profitable. A I'calization lliat lack of reading skills 
is keeping them from their desimd goals has brought them, to the 
Reading Laboratory. Although through their daily experiences 
they develop knowledge of the working world, they want some 
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help in broadening tlmir understanding of fiolda of work and of 
tlioso qualities which contribute to advancement. 

Tho work of a reading laboratory, therefore, could be strength¬ 
ened by placing moro emphasis on educational and vocational 
guidance. Vocational interest could conceivably provide tho 
motivating force in accolcrating gains in rending skills, but, 
above all, knowledge of tho working world is due these students 
because of tho imminence of earning a living and tvssuming the 
duties of citizenship. They should be given some idea of their 
rosponaibilities as citizens and some idea of how our government 
works and of liow much reading skill they need for their chosen 
work and for citizenship. 

Teen-age boys and girls following re-training in reading, should 
have at least a tentative vocational goal, and sliouid leave tho 
reading laboratory for a school where they may expect training 
which will help tUcrai attain that goal. Therefore, some voca¬ 
tional aptitude testing should bo planned for this group—not 
nocossaiily within tho reading laboratory, itself. 

A study of occupations, if introduced into the program of 
the reading laboratory, could contribvilo to tho reading program, 
widen tho horizons of these boys and girls as their reading skills 
are being dovolopod, and fortify them with knowledge of tlicm- 
solvcs and the world of work which will liclp thorn and Ihoir 
parents to Bcloct tho schools which lUoy will enter following 
training in reading. Any such courses, however, must con- 
tributo, as well to tho dovciopmonfc of reading skills and must bo 
planned to harmonize with tho philosophy and method of the 
reading program. 

The schools in tho area of tho reading laboratory should bo 
known to the laboratory, particularly those schools where stu¬ 
dents may build on the reading skilb developed in tho reading 
laboratory. It is important to know, also, the schools where 
vocational training is given. Schools which develop ejjcclal 
talents and yet do not require a high-school diploma, should bo 
known to the iaboi’atoi*y. There should bo knowledge, too, of 
educational advisomont .services and of the most readily available 
and reliable vocational advisement and testing sorvico. 

It appears that a group guidance course would bo tlio logical 
means of helping the students of a reading laboratory develop 
their understanding of tho world of work, develop some skill 
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in the scrutiny of self and some ability to determine means and 
places for self-improvement. It should be the aim of such a 
course to bring about the increasing ability for self-guidance 
and self-direction which will stand by the student after he has 
loft the relatively protective atmosphere of the reading laboratory. 

In February of last year, such a course was introduced into 
the program of the Reading Laboratory at tho University of 
Bridgeport. It was offered to a group of five adolescent boys, 
only one of whom had been a regular high-school student. 
These boys were at ease with one another, thus presenting no 
problems as to free discussion. They were thinking in terms 
of the future, and were, therefore, already motivated. The 
teacher had had training in the techniques of group guidance 
and had had experience in group work, 

DATA ON A REPRESENTATIVE CLINIC GROUP 

It was at the beginning of the new semester in February, 
that the course in group guidance was introduced. It was 
planned for two half-hour periods per week, coming the last 
period on Tuesday and Thursday. Tho group was programmed 
to road history with the same teacher at the same time on 
Monday and Wednesday, thus maintaining contact. 

There follows a description of each student in the group: 

1 

Martin, who is sixteen years old, has been a tenth-grade 
student in a nearby high school where his grades have been D's 
with an occasional C. Both the Principal and the Guidance 
Director of the school and also his mother are interested in 
Martin, who is preparing for a business career. Hia mother has 
migraine headaches, and frequently withdraws from her children, 
insisting on quiet in the home. Tho father is frequently away 
from homo, and when at homo is unsympathetic toward the 
children whom ho feels are not a credit to him, 

Test results for Martin indicated that hia intelligence quotient 
places him in the dull-normal range; his memory is reliable and 
even. Ho is immature emotionally and does little thinking for 
himself. He is high in acuteness of observation and ability 
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to handle concrete problems; low in practical judgment. He has 
satisfactory vision at near point. His dominance ia completely 
right. In oral reading lie is slow nnd inaccurate and in silent 
reading lie place.s on grade level 5.4—lliUH evidencing a rotarda- 
lion of five years. lie reads simple material at 172 words per 
minute with good comprehen.'jion. The jiHyohologiHL concluded 
that while Marlin does not appear to liavc much capacity (or 
educational tasks involving verbal proldoma, he appears to be 
able to do tasks involving design, mechanical drawing and otlior 
concrete skiUs. 


II 

Kevin, aged sixteen, is the aon of a mother who is a college 
graduate and of a father wdio is a successful businosa o.xecutive. 
Hia sister is in college and is doing well. Kevin was very ill 
as an infant, but has had no serious illncBSKhicc ho was six months 
old. Kevin never learned to read. He iej>ealed tlic first grade; 
has had his school situation changed fi'criiiciUly; has been 
tutored, and yol, ho finally reached the Qightli grade unable to 
read. lie came to the lleading Haborntory in Marcli, 1048, for 
training. 

The tests administered indioate that his intelligence quotient 
is in the average range. lie U emotionally irnmalvirc, very 
unauro of liimself and gives up easily. His teat of vision indi¬ 
cated some difficulty at near point but the ophtlmlmologiat 
does not believe that a correction is indicated, llis dominance 
ia chiefly right, although ho does some things willi hia left hand. 
Oral reading of very simple material is accomijlishcd in a pain¬ 
fully slow manner with much stammering; in silent reading lie 
placed on grade level 3.2 and hia graphs show reading of simple 
material at 128 words per minute with modoralo comprehension. 

Parental plans for Kevin arc to have him enter high school for 
low-lovcl students where ho will take some commercial subjects 
and some trade training courses. Kventimlly, ho will go into his 
father's business, which is the sclUng of brick. 

lU 

Charles is fifteen, and has been failing in all subjects in the 
eighth grade, Ho repeated the aoventh grade. His trouble with 
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reading began in the fourth grade. He haa never been a behavior 
problem, His family find him a helpful member of the group 
but a reticent one. He has one brother, age seventeen, who ia 
getting along fairly well in high school. 

Charles' intelligence quotient ia in the average range. He has 
a poor memory. Emotionally he is veiy immature and suffers 
greatly from feelings of inadequacy and insecurity. His test of 
vision shows trouble with lateral imbalance. His dominance is 
completely left, but he uses his right hand in golf. His oral 
reading is slow and punctuated with errors; his placement on a 
silent reading test is 5.7 and ho reads 60 words per minute with 
good comprehension. 

Charles' family would like to have him enter a vocational 
high school, but Charles has told his brother that he wants to 
go to a regular high school. 


IV 

Gilbert is sixteen. His mother is a college graduate; his father 
attended a university. His sister is in college at present. Hia 
brother, who is older, is a non-reader; he is successfully operating 
a farm. They have a good home life although there was much 
tension in the home during the depres^on years. Gilbert repeated 
the first grade and has since been pushed ahead until he reached 
the seventh grade without any significant accomplishment to his 
credit. However, he was always excellent in drawing. 

Gilbert’s intelligence quotient ia in the dull normal range. 
He is a slow thinker and a slow learner. There are no indications 
of emotional disturbance. His vision is satisfactory at both near 
and far point. His dominance is completely right. In oral 
reading, he is very slow and inaccurate. On a silent reading 
test, he places at grade level 3.4 and ho reads 100 words per 
minute with ninety per cent comprehension. 

Gilbert is interested in carpentry and masonry and does such 
work around his home and on his brother's farm. Ho has good 
work habits; he is very reliable and systematic. He handles 
money well. His ability to draw is marked. The instructor 
from the Art Department of the University who has had this 
group of boys for sketching, saya that Gilbert is very intelligent 
about following directions and that his achievement in this class 
is outstanding. 
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V 

John is sixteen and the member of a very colicsivo family. 
I-Iia Bistor ia in college and hia twin brollior ia in high acliool, 
John progressed through tlic grades of a private school without 
significant nccomplislinicut and came to Iho Heading Laboratory 
in January, 1948, practically a non-rcttder. 

Tests show hia intelligence quotient in the average range, 
Marked emotional disttu'bancc, insemirity and anxiety are 
present. He is aggressive, egocentric, and Homowhat hostile. 
His vision is saliafnctory. In dominance, he is completely loft. 
His oral reading ia slow with many crroi-s. At the time John 
became a memljcr of the group guidance, class, hia silent reading 
waa on a 6.2 grade level, his spelling on 4.7. He was reading 207 
words per minute with excellent comprehension. 

John has an aptitude for business and has dojrc much work for 
hia father, who ia a building contractor. lie undorstands money 
and the apirit of competition. He owns and drives a car. lie ia 
getting training in tlie various building trades llu'ough the work 
ho ia doing; the training ia ovidcntly planned. He can read ))luo 
prints to some extent, but both he ami hia family expect him to 
take some tochnlcal training in the drawing of plans. John has a 
pleasant manner but is dofieient in a sense of seoial respensildiity. 

C- 1 

Thcao five individuals am a typical reading laboratory group. 
They all need help in adjusting to the world of work ns well as 
training in reading. Pundamcnlally, they have tlio Humc nce<lfi, 
but 08 mclividuala differ sufUciently ao that they will benefit from 
the interplay of group thought and group discussion. 

The major purposes of this group guidance course were dotcr- 
mined as: 

1) To give to the student certain basic concepts concerning 
responsibilities of citizenship, acceptable social bolmvior, succcrb 
in any occupation. 

2) To aid the student in obtaining adequate and accurate 
information about schools and ooursos so that ho may have fuels 
on whioh to baeo his docieions. 

3) To present to the student a method of investigating occupa¬ 
tions, 
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4) To assist the studeat in making tentative plana for the 
future. 

To achieve the first purpose, lessons were planned using Unit 
Number 1 of the Occupations Course by R. Floyd Cromwell and 
Morgan D. Parmcntcr, published by Guidance Publishing Com¬ 
pany, Limited, and distributed by the Psychological Corporation. 
Each student was provided with a text notebook and instructed 
in its use. 

The instructor developed worksbeete according to the methods 
of the Reading Laboratory which has a definite philosophy under¬ 
lying its reading instruction. These worksheets were attached 
by eacli student to his text notebook, being placed following 
the chapter on which each was based. 

The lessons based on the Cromwell and Parmenter text note¬ 
book (twenty-four in all) were carried on through group dis¬ 
cussion, silent reading in class followed by tests of comprehension 
and oral reading. The problems selected for discussion and the 
cases analyzed by the group were chosen with the needs and 
interests of those particular boys in mind. 

The lessons on occupations wore developed using material 
published by the Bureau of Vocational Guidance, Connecticut 
Department of Education. Worksheets to bo used with each of 
ton job analyses written for junior high-school students wore 
prepared by tho instructor. These worksheets were designed to 
accord with the philosophy and method of the Reading Labora¬ 
tory and to point up the thinking of the student in regai’d to the 
important items to be considered when looking into any job. 
Each member of the group worked on his choice of three of the 
ten job analyses offered. 

Tho lust three lessons were designed to give the students 
information on schools in the Bridgeport area. Bulletins and 
other descriptive material were read by the students. Letters 
of inquiry were written by students to tho special schools which 
Hccmod to offer training suited to their interests and aptitudes. 
The last lesson placed emphasis on the importance of tentative 
vocational plans, stressing the need for flexibility in these plans 
and the advantage of broad training over training in specific 
skills at this stage in their education. 

Flashmeter work is part of the daily program of every student 
in our Reading Laboratory. It is used to quicken visual and 
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mental perception and, therefore, material aolectcd for reading 
is familiar to the class in subject matter and is in accord with 
their intercats. The reading of a paragraph is, as a rule, the 
final part of tlio lesson. A series of ten paragraphs were pre¬ 
pared by the teacher conducting the group gvudanec course and 
presented by the Leacljcr avIio had this group of students for 
fljwhmotcr work. This served m review and as a moans of 
emphttsiaiing certain asiKicts of the course. 

Good citizenship means voting, paying taxes, obeying the 
la\vs of tiio land; but moi'e than that, it means a willingness to 
be informed and to study to some degree problems of government. 
To give those boys a concept of group relationships and of the 
responsibility of the individual to tlie group, togetlior with a 
broad view of government funclLonS} was necessary if the purpose 
of giving tho student a basic concept of the responsibilities of 
citizenship was to be achieved. 

Inasmuch os time did not permit this to be worked into tho 
thirty lessons specifically allotted to group guidance, tl\ 0 B 0 
lessons on citizenship were subslitulod for a number of history 
lessons. The text selected was ]Ve Are The Government by Mary 
Elting and published by Doublcday, Doran and Company, Inc. 
This is an accurate and iniercsting account of tho various depart¬ 
ments and brandies of tlic Ecdcral Government. It is written 
simply enough to bo read by these boys, and yet it is sufficiently 
adult in format and presentation that they will not feel affronted. 
This is tho text used for reading. Questions to lost comprehen¬ 
sion aro prepared by tho teacher. 

Ti\c weekly assembUcs of tho student body at the Reading 
Laboratory provide occasions for these boys to present to the 
younger students their concepts of good citizenship and their 
broadening view of their country’s development. This widens 
the horizons of tho younger students, motivates tho members of 
the group guidance class and gives them practice in expressing 
their opinions in public. 

One device used in the Reading Lal>oratory to encourage 
• independent reading, is a largo file card on which the studonl 
keeps a record of tlic books he has read. A slicif of books from 
the library on subjects related to this course was placed in the 
group guidance classroom. Students were encouraged to select 
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books for independent reading from this shelf and to add it to 
their record of books read. They -were invited to summarize 
and evaluate these books for other members of the group. 

Most group guidance courses plan some aptitude testing for 
the members of the course. Since this was in the tradition of 
such courses, throe paper-and-pencil tests were administered by 
the instructor to this experimental group in the Heading Labora¬ 
tory. The tests administered were the Revised Minnesota 
Paper Form Board Test, the Bennett Test of Mechanical Com¬ 
prehension, and the O’Rourke Mechanical Aptitude Test, 
Junior Grade. Nothing definitive was indicated by the results 
of these tests. Arrangements have now been made to administer 
Performance Tests of Aptitude to these students through the 
Personnel Division of the University of Bridgeport. 

CONCliTISIONS 

Work with this group of adolescent boys during these three 
months suggests that a group guidance course should logically 
form a part of the program of the Reading Laboratory. 

1) Interest in learning about occupations and the qualities 
which contribute to success in the world of work, motivates 
reading and, therefore, contributes to the development of reading 
skills in the student. 

2) The material used is on an adult level and, yet, Avithin the 
ability of these students to read under guidance; therefore, 
it fills a need constantly felt in the Reading Laboratory—that 
of providing material Avhioh takes into account the interests of 
students, which is presented in a manner and format suited to 
their age, and which is within the range of their reading ability. 

3) The work of this course stimulates thinking along adult 
lines and, thus, contributes to the maturing process of these 
boys, a need usually revealed in the initial testing. 

4) The lessons on citizenship fill a definite need in that they 
contribute to the maturing process of the student, give him back¬ 
ground material Avhicli he missed In his regular schooling because 
of deficient reading, and stimulates his thinking and reading 
along broader lines. 

6 ) Performance tests rather than paper-and-pencil tests 
should be given to determine the individual aptitudes of the 
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mombers of such a group. This should be done by exports who 
are working regularly in this field. 

6 ) Through this group guidanco course the student is helped 
to choose ft tentative goal and to make plans for training upon 
finishing his work at the Reading liftboratory, thus making it 
more likely that the akilla and work habits acciuircd in the Labora¬ 
tory will bo maintained and developed. 



RELIABILITY AND VALIDITY 
OF INVOLUNTARY BLINKING AS A MEASURE 
OP EASE OF SEEING* 

MILES A. TINKER 
UnWfttaity of Minncaota 

In any measuring device, the problems of reliability and valid¬ 
ity are of high importance. The reliability of any measuring 
instrument is the consistency with which it measures the kind 
of response or behavior involved. Validity of a technique 
depends upon the fidelity with which it measures whatever it 
purports to measure. Only when adequate reliability and 
validity of an instrument, test or technique have been demon¬ 
strated, can one place confidence in results obtained by that 
measuring device. 

Rate of involuntary blinking has been extensively used by 
Luckiesh*“ and Luckiesh and Moss'< as a criterion of ease of seeing 
and of readability of print. In fact data obtained by this tech¬ 
nique (rate of blinking) form much of the bases for conclusions 
and recommendations concerning adequate illumination intensi¬ 
ties and desired typographical arrangements. Luckiesh, Guth 
and Eastman*^ point out that researches by Luckiesh and by his 
co-workers employing the blink technique over a period of years 
have yielded useful data in the study of level of illumination and 
of typography. In another place Luckiesh® states that rate of 
involuntary blinking while reading is a very sensitive criterion of 
ease of seeing. He also claims in this report that rate of blinking 
while performing the same task under different conditions (as 
changes in level of illumination) is by far the most sensitive, sig¬ 
nificant and practical criterion of ease of seeing that has been 
used, 

Since rate of blinking is considered such an important criterion 
of ease of seeing, it is of considerable importance to evaluate the 
reliability and validity of the technique. It might bo noted 
further that, in using this technique, the certainty of discovered 
difTerenecs should be evaluated statistically. The purpose of the 


•Tho writer is grateful to tho University of Minnesota Graduate School 
for a resonroh grant to finance this study. 
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preaent study is to present and coBrdmate the results obtained 
in a Jiumbor of my studies on reliability and validity of the blink 
technique as a measure of ease of seeing. 

ilKLIAllILlTY 

In an initial study^* Iho blink rales wore recorded for each 
successive fivc-minuto period during tliirty minutes of reading 
(or two groups: aevenly-four adult rcadem and aixly-four aduH 
readers. Clouditions of the experiment wore comi)artvblc to 
Ihoao specified by Luckioah, Gnth and Kivslmnn.'* lilinlc rates 
in both seta of data tended to increaao sliglitly in the successive 
five-minute periods of reading. The Idink-rute consistency or 
reliahility coofiicient was fairly high from one livo-minuto period 
to the next period, i.c., mean about .87. The IreiiclH were about 
the same for adjacent ten-mii\iitc perioils of reading (.85). From 
initial to fmal (Ivo minutcu (of the thirty winutca), t\\e reliability 
dropped to about .60. For the ten-minuto periods of reading 
at the beginning nml end of Uic thii'ty-inimitc period, the reliabil¬ 
ity wua about .Of). For tho first 15 miiiutcH vs. the last 16 
minutes the reliability coeflicient wus .76. 

In a second invt^ligntion,** frequency of blinking was recorded 
while reading lowor-cnse text and nil cnpilnl text for ten minutes 
each during oacli of two experimental sessions. Thero were 
sixty subjects, llecords were kept for each live minutc.s of tho 
ten-raiiiutc periods. On comparing the reliability of the blink 
frequency from one session to the next, tlio cotdlicicnls wore 
uniformly high: .80 for fivc-minulc periods; .80 for ten-minuto 
poriodflj and .04 for twenty-minute periods. 

A third study’* was concerned with blink rate in reading book 
type and newsprint. There were sixty subjects. Records were 
kept for each five mmutca of the ten-minute reading periods. 
For the fivo-minuto periods the rcliabiliiiGS wore .82 and .84; for 
ton-miiuitoa it was .95. 

In a final study,’® forty-two subjects read for lifty-llvo miiiutoa 
under two footcandtea of light and for u like period inuler one 
hundred footcandics. Blink frequency was recordcrl for the 
initial and final five minutes of each period. For reading under 
two (oolcandlca tho reliability (first vs. final five inimitca) was 
.87; for one hundred footonndics, .67. 

When data in all four studiGS are considered, trends in reliability 
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coefficients are as follows: For successive five-minute or ten- 
minute periods of reading, and for five-minute or ten-minute 
periods of reading at two separate experimental sessions, the 
coefficients are relatively high—around ,85 to .96. This repre¬ 
sents highly satisfactory consistency of performance. When 
initial and final five minutes of thirty to fifty-five minutes of 
reading are compared, the reliabilities fluctuate around .50. 
But in one case out of four a coefficient similarly derived was .87. 
Ten minutes of reading yields slightly higher reliability than five 
minutes. It may be concluded that consistency of performance 
in measuring blink frequency during reading is adequate where 
group comparisons are involved although these coefficients at 
times barely reach the minimum requirements when initial and 
final five minutes of a lengthy period of reading are compared. 
For any short period of five to fifteen minutes of reading, the con¬ 
sistency or reliability of blink frequency is highly satisfactory. 

In most other studies of blink frequency, reliability of perform¬ 
ance has nob been ciled. In Carmichael and Dearborn’s investi¬ 
gation,® groups of ten subjects each read on different occasions 
various kinds of material for six hours. Blinks wqyq recorded 
for the first five minutes of reading and for the last five minutes 
of the successive twelve half-hour intervals. Correlations were 
computed between initial scores and the scores at the end of each 
successive half hour. These (reliability) correlations reveal how 
consistently the subjects maintained their original positions in 
the group. Although these coefiicients revealed wide variabil¬ 
ity, ranging from .00 to .99, four-fifths of them were .70 or above. 
Very few were below .60. In most of their samples, therefore, 
the reliability of the blink technique seems adequate. 

VALIDITY 

In various reports,*^-*®’*^ Luckiesh and his coworicers have 
employed and supported rate of involuntary blinking as an 
adequate measure of readability of print, of ease of seeing, visual 
efficiency, ocular fatigue, etc. The assumption is that rate of 
involuntary blinking increases with the severity or difficulty of 
the task and thus reflects the degree of effort expended by the 
subject in performing the visual task. The validity of a measure 
should be established in terms of how well it agrees with a cri¬ 
terion. And a criterion is ordinarily considered to b e some measure 
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■which experience has shown to bo an adequate or true measure 
of the trait under consideration. 

Three studies have been completed in our laboratory to check 
the validity of blink rate os a measure of ease of seeing. In the 
first investigation,the relative readability of text in all-capital 
printing was compared with text in lower-case. Earlier studies 
have established that all-capital text is significiintly loss readable 
than text in lower-case. Tinker and Paterson*® demonstrated 
that all-capital text is read about twelve per cent slower than 
lower-case text. The same trend was discovered in an eye- 
movement study.** Measuring the trend in blink rate in a 
similar comparison will, therefore, furnish a check on blink rate 
as a measure of readability. 

The experiment was carried out in a light laboratory with 
ten footcandles of well diffused illumination. Sixty university 
students served as readers for tw’o experimental sessions, reading 
lower-case text followed by nil-capital text at one session and in 
tho reverse order at the second session. A counter-balanced 
experimental design was used and the subjects were adapted to 
the illumination prior to the reading. Comparisons were made 
for live, ten and twenty minutes of reading. Both number of 
blinks per period and rate of reading were measured. The find¬ 
ings rovoalcd no significant di/Tcronces in rate of blinking w'hile 
reading text in all-capitals in comparison with lower case. But in 
all comparisons, the text in all-capitals ^Ya8 read significantly 
slower than text in lowor-coso, i.e., 9,63 to 10.01 per cent slower. 
The findings suggest that frequency of blinking is an unsatis¬ 
factory criterion of readability of print. 

A second study*^ was concerned with the readability of book 
print and newsprint in terms of blink rate. In earlier work, 
Paterson and Tinker^® have shown that newsprint is read sig¬ 
nificantly slower than book print. All evidence*^’'* indicates 
that ease of seeing largo (book) type is greater than for small 
(newsprint) typo. A comparison of blink rates for these mate¬ 
rials, theroforc, should provide a check on tho validity of blink 
rate as a measure of ease of seeing. In tho present study tho 
book type was twelve-point; the newsprint, sovon-point. Speci¬ 
fications for experimental design and procedures laid down by 
Luokiesh were followed. For details see tho original report.*^ 
The results show significantly fewer blinks (61.27 vs. 69.37) for 



Involuntary Blinking as a Measure of Ease of Seeing 421 


reading the newsprint. This trend is directly opposite to what 
should have occurred if rate of blinking is an adequate measure 
of ease of seeing, i.e., there should have been more blinks in 
reading tire newsprint. Obviously, further checking of the 
validity of the blink technique is needed. 

In the third atudy^® concerned with influence of illumination 
intensity, the specifications of Luckiesh, Guth and Eastman^* 
and Luckiesh and Moss'* concerning experimental design and 
proceduves were followed in detail and the same reading materiel 
was used. Forty-two university students read for fifty-five 
minutes under two and under one hundred footcandles of light. 
Frequency of blinking during the first five and the last five 
minutes of the fifty-five-minute period were recorded. Details 
of conditions and procedures are given in. the original report. 
The problem in this experiment is to check whether frequency of 
blinking increases significantly more for reading fifty-five minutes 
under the dim than under the bright light. 


Table I.— Changes in Rate oj Blinking when Reading 
Fifty-five Minutes under Two and under One Hundred 
Footcandles op Light. N = 42 Readers. 


Foot- 

1 FiTst 5 Min. ^ 

1 Last 5 Min. ^ 

■ 

1 

% 

D 

Candles 

Mean 

SD 

Mean 

SD 

■ 

Diff. 


2 

26.8 

23.2 , 

33.9 

27.9 1 

.87 

8.1 1 

31.6 

5.60 


26.8 

19.4 1 

35.4 

24.6 1 

.67 1 

8.6 j 

32.0 

3.97 


The basic data are given in Table I. Examination of the 
means reveals that there is an appreciable increase in number 
of blinks from initial to final five minutes of reading under both 
levels of illumination. Those changes in blink rate are significant 
at the one per cent level as shown by the critical ratios in the 
last column of the table. The same level of significance is 
obtained when the /-test is applied to the data. 

Under two footcandles, the increase in blink rate is 8.1 or 31.6 
per cent. Similarly, under one hundred footcandles, the increase 
is 8.6 or 32.0 per cent. There is, therefore, an approximately 
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idontioal amount of increase in blink rate for reading about an 
hour under two and under one hundred footcandles. 

It is universally recognized, in terms of literature on the sub¬ 
ject, that reading under two footcandles ia a more eevere visual 
task than reading under one hundred footcandles. There is no 
trend in the blink data of this experiment to support this view. 
Under the conditions of this experiment, therefore, rale of invol¬ 
untary blinking is not a valid criterion of case of seeing in reading. 

DISCUSSION 

Reliability or consistency of performance in rate of involuntary 
blinking appears adequate. In those stiulio-s whore the reliabil¬ 
ity has been computed, the cocfricicnts tend to run fairly high 
for most samples. Ncverthclcaa, eince low reliability occurs 
occasionally, the reliability should be computed in each investiga¬ 
tion where the blink technique ia used. 

Validity of the blink technique aa a measure of onao of seeing, 
however, ia in question. In Luckiesh and Moss'® and Luclcicsh,"’ 
the findings reported uniformly show increases in rate of blinking 
under conditions wliich presumably involve more difiioult visual 
tasks such as witli reduction in size of type, intensity of illumina¬ 
tion, uniformity of lighting, etc. They conclude that blinlc rate 
as a criterion of ease of seeing ia uniquely sati-sfactory. But 
check studies have failed to obtain data confirming tlie trends 
published by these authors. 

McFarland, llolway and Ilurvich,'® in view of their findings 
and analyses, conclude that a high blink rate need mean neither 
an increase in visual fatigue nor an incrco-se in difiiculty of seeing. 
In his study, Bitterman* found a decrease in worlc output for 
reading six-point in comparison with ten-point type but no sig¬ 
nificant difi'erence in blink rate for reading the two sizes of type. 
In the same study he found no significant difference in blink rate 
for reading under three and under ninety-one footcandlcH of light. 
In both comparisons the slight but insignificant difforcncos were 
in favor of the more severe visual task which is contrary to the 
trends found by Luckiesh and hia co-workers. Bittorman con- 
oludea that rate of blinking cannot be accepted as a criterion of 
readability and ease of seeing. In a later analysis Bittorman 
and Soloway* demonstrated that expenditure of greater effort in 
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mental work is not necessarily reflected in an increased frequency 
of blinking. 

Simonson and Brozek,*® in studying the effecbs of illumination 
level on visual performance and fatigue, employed the severe task 
of visual discrimination in perceiving veiy small letters under 
two, five, fifteen, fifty, one hundred and three hundred foot- 
candles of illumination. Work output increased significantly in 
going from two, five or fifteen footcandles to the higher levels of 
illumination but there were no significant changes in blink rate. 
They conclude that the blink technique cannot be employed as a 
fatigue index. In a later study on the effect of spectral quality 
of light on visual performance and fatigue, these same authors*® 
found that blinking rate did not show significant changes between 
illuminants although there were significant differences in certain 
performance and fatigue tests. In Carmichael and Dearborn's 
experiment® samples of blinking wore taken at half-hour intervals 
during six hours of normal reading and microfilm reading. There 
were more blinks for normal reading than for the microfilm 
reading although most of the differences were not significant. 
Conclusions are not clear here for adults read microfilm faster 
and high-sohool subjects were more rapid in the normal reading. 
In studying the influence of typographical variations on reading 
by visual handicapped children, McNally*® found no significant 
differences in frequency of blinldng from one kind of text to 
another. Rato of reading revealed no significant differences 
cither. Hence the whole set of data seems equivocal. 

When all studies on the blink technique as a measure of ease 
of seeing arc examined the following trends are revealed: (A) 
Luckiesh and his co-workers always report data that appear to 
indicate a higher rate of blinking for situations where the visual 
task is more exacting. (B) In all other investigations either (a) 
there are no significant differences in frequency of blinking in 
going from easy to severe visual tasks or (b) the trends of tho 
data are equivocal. (C) There arc, therefore, serious doubts 
concerning the validity of the blink technique as a measure of 
ease of seeing. 

In reply to criticisms'-** of the blink technique, Luckiesh"-** 
has argued that workers in other laboratories have not duplicated 
his experimental set-up and methods of procedure, nor maintained 
the same reading attitudes in the subjects. Nevertheless, inabil- 
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ity to confirm Luckiesh’s results cannot bo clue to these factors 
for Tinker's recent experiment** duplicated all conditions and 
arrangements specified by Luekieah. The data revealed no 
significant differences in blink rate for rending under two va. 
one hundred footcandles of light 
Luckiesh*^ and Luokiesh, Guth and Kastman** imply that the 
increase in frequency of blinking from the beginning to the end 
of a lengthy period of rending supports the view that the tech¬ 
nique 18 valid ae a measure of cmc of seeing. They point out 
that when conditions arc comparable to those in their experi¬ 
ments, findings aro similar. The following data were cited (per 
cent increase in blink rate is given in parentheses at end of items): 


Luokiesh and Moss (N = 11), 00 min. of reading....... (31) 

Hoffman (N = 30), GO min. of reading. (27) 

Tinker (N = 7'1), 30 min. of reading. . (26.2) 

Tinker (N *> 04), 30 min. of reading. (36.2) 


It is obvious that tlic trends toward increase in frequency of 
blinking from beginning to end of a period of reading agree, It 
is doubtful, however, that this li*ond implies anything concerning 
the validity of the blink technique oa a measure of case of seeing. 
This trend toward an increase in blink rate is found in practically 
every experiment, l^or instance, Tinker"** found an inevoase of 
31,6 and 32 per cent while reading fifty-five minutes under two 
and one hundred footcandles, respectively. And Carmichael and 
Dearborn® found increases of about twenty-one, twenty, thirty- 
nine, and thirteen per cent for reading from two to six hours 
under sixteen footcandles. Many of tiioso differences arc statis¬ 
tically significant. IIolTman*'* has suggested that the change 
(presumably of a deleterious nature) in blink rate with continu¬ 
ous reading is the effect of a work factor (work decrement phe¬ 
nomenon). This seems a reasonablo inforenco. Apparently 
Carpenter,® in his study of changes in rate of blinlcing during 
visual search, has interpreted this work decrement phenomenon 
as validating the technique as a critorioh of case of seeing. His 
increase in blinks from the first to the last half hour of a two- 
hour period was forty-threo per cent. This is somewhat greater 
than the inoreases (about thirty-two per cent) found for one to 
two hours of reading. 

In any ease, if differential increase in froquoncy of blinlcing due 
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to visual work is to be employed as a criterion of ease of seeing, 
the increase during a severe visual task should be greater than 
during an easy task by a statistically significant amount. No 
independent worker, however, has been able to confii’m the results 
reported by Luckicsh and his co-workers when such comparisons 
have been made. 

A word may be added eonccvning the statistical treatment of 
blink-rate data. Tinker^® has questioned the appropriateness of 
the geometric mean as employed with these data by Luckiesh 
and his co-workers. The same criticism is offered by Hoffman.® 
He also severely criticizes the use of the percentage technique 
employed by them, and for basing conclusions on percentage 
differences rather than on raw score differences. Percentage 
differences are notoriously unreliable, furthermore, if the raw 
acorea are below IQQ (as most of them are), percentages magnify 
the differences. Thus insignificant raw score differences may 
seem large when put into percentage differences. Furthermore, 
all obtained differences should be evaluated for statistical 
significance. 

The trend of the data reported here plus a survey of related 
oxporiinonts raises serious questions oonoorning the validity of the 
blmlc technique aa a mcasuYO of case of seeing and readability 
of print. On the one hand are the data reported by Luckiesh 
and hia co-workcra. They'® conclude Hint frequency of blinking 
"while reading is a very sensitive criterion of ease of seeing and 
that the results are significantly related to tenseness and other 
results of reading and other critical seeing.” On the other hand, 
no independent worker, even when duplicating the experimental 
design of Luckiesh, has been able to confirm the results of 
Luckiesh and his co-workers. These independent workers all 
find that increasing the severity of the visual taslc has no differ¬ 
ential effect upon frequency of blinking. Although the fre¬ 
quency of blinking does incrense as reading is continued for 
thirty minutes to an hour or more, the rate of increase ia no 
greater for sevoro than for easy visual tasks. Lack of confirma¬ 
tion of the Luckiesh findings can no longer be assigned to differ¬ 
ences in experimental design.®® The basis for the apparent 
consistency in the data from Luckiesh's laboratory and whicli 
cannot be confirmed by others is not clear at this time. 

In any case, failure to substantiate the rate of blinking as a 
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criterion of ease of seeing and of readability must lead to its 
rejection oa an adequate technique in studies of visual work, 
Bittcrman and Soloway* tend to agree with these conclusions. 
This would mean that much of the evidence put forward by 
Luckiesh**’ and Luckiesh and Mosa*^ to support recommendations 
for desirable practice in the hold of illumination and typograph¬ 
ical arrangements is invalid and that the recommendations, there¬ 
fore, arc without sound foundation. 

Various techniques, including frequency of blinking, have been 
promoted as measures of cHicicncy in terms of tho physiologieal 
cost of the work. None of these have been satisfactory. It is 
generally admitted, however, that an adequate measure of energy 
expenditure during visual work would yield important data to 
supplement work-output results. In the absence of the former 
it is feasible* to rely upon data from performance measures until 
more sensitive and valid indices of cost have been developed. 

HUMMAUY AND CONCLUSIONS 

1) The results of four oxperimonlB concerned with reliahiUty 
and validity of frequency of blinking as a measure of ease of 
seeing are reported. 

2) Consistency of response or reliability of blink rate is ade¬ 
quate as used in experiments on readability and ease of seeing. 

3) Frequency of blinking is not a valid mott.suro of readability 
and ease of seeing. 
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THE ORIGIN AND DEVELOPMENT OF THE 

SPANISH ATTITUDE TOWARD THE ANGLO 
AND THE ANGLO ATTITUDE TOWARD 
THE SPANISH* 

OIIANVILLK B. JOHNSON, JR. 

Arisontv Slnlo College ot RlngalafT 

The problems derived from hitcrgroup nUiludes ivro varied and 
their solution is particularly imporlont at the present time from 
the fitaJidpoiat of national and international maladjustment. 
Ilcscarcli which probes the origins and traces the dovclopment 
of racial ottitudea at the molar level would make a positive con¬ 
tribution to developmental and social psychology. 

Underlying the present investigation is the c.xplicit assumption 
that any mcfisui'al)lo diiTcrencoB of pomonality between races or 
ethnic groups are duo to an environmental ami not a hereditary 
funotion. We are in agreement with the conclusions of Boaz: 

*'Tlie occurrence of liorcditary mental traits tlmt belong to a 
particular race has never been proven. Tlio available evidence 
makes it much more likely that the same mental traits api)car 
in varying distribution among the principal racial grovips. The 
behavior of an individual is therefore dotormined not by his 
racial afTiliution, but by tho character of his ancestry and his 
cultural environment. Wo may judge the mental characteristics 
of families and individuals, but not of raco."^ 

708 pnonnE^^i 

Tho purpose of tho present investigation was to ascertain tho 
degree of projudicc in progressively matui'e age groups of Spanisli 
and Anglo subjects utilizing tho Projective Test of Racial Atti¬ 
tudes and to reveal something of tho origin and development of 
racial attitudes. 


* This ia tho socond in a sorica of throo nrlifllctj coticcrncd with tho origin 
and dovoiopmonl of rnoiol atUludo. Tho ptovioiis paper, "An Expori- 
mental Projective Tcolmifpio for llio Analyst of Racial Attitude,'' appeared 
in April Issue of this JoornaIj (41:4, p, xxx). In tills enriy article tho 
propOTlioB of tho Projeoiivo Teat of Baoial Attitude, tho major tool in tho 
present invostigation, wore analysed. 

488 
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MATERIAL AND SUBJECTS 

Materials. —1) The Projective Test of Racial Attitudes com¬ 
posed of six carefully selected pictures I’clevant to race situations 
and provocative of projected response was utilized for the analysis 
of racial attitudes. There was a hero figure with whom the 
subject identified himaolf and thus projected something of the 
dynamics of his personality into the depicted situations. 

The situations conducive to projected response were identical 
except for the ethnic group variable. Tor Anglo subjects there 
were six cards of total Anglo content and six with an Anglo hero 
in a Spanish situation. For Spanish subjects the situations 
were reversed with a Spanisli hero in an Anglo situation in six 
cards with identical cards without tho Anglo element. 

2) A tabulation sheet was utilized for recording the dynamics 
of responses. 

Subjects. —1) Anglo: thirty male subjects (foiir-j eight- and 
twelve-year levels, N *= 90) from public schools in a south¬ 
western town. 

2) Spanish: thirty bilingual male subjects (four-, eight- and 
twelve-year lovela, N = 90) from public schoola in a south¬ 
western town. 

A further limitation was that members of both gro^ips were 
required to have lived in this specific town for the year prior to 
testing. 

DEVELOPMENTAL CURVES 

The first phase of tho analysis was to trace tho development 
of the Spanish attitude toward the Anglo and the Anglo attitude 
toward the Spanish. This was accomplished by computing the 
total number of responses in the Spanish-Spanish (Anglo-Anglo) 
columns and the Spanish-Anglo columns at each age level, then 
finding the significance of the difference between them. Tho 
change in the relative number of lusponscs and resultant change 
in the significance of the difference was noted with increase in 
ago. 

Spanish .—Tabic I prcsents the significance of the difference 
between samo group and not same group of ninety Spanish 
subjects, four, eight, and twelve years of age on the twelve cards 
of the Projective Tost of Racial Attitudes. The difference 
indicated greater reaction in the Spanish-Anglo situations. 
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Tho analysva included: Effect of Environment (Frustrating); 
Reaction to Environment, (Frustration); Adequacy of Principle 
Character, (Superior); Ending Hero, (Pefeat); and Ending 
Thome, (Unsatisfactory). 

TaULJJ I.— SlONIPlCANCB OP DiPPEUBNCE niCTWKKN Sl»ANlSU- 
BPAN1811 AND SpANlSll-AKQLO llEftPONSES UkiNQ TiIIUTY 
Spanish Suiuects at the Four-, Kigu'i^ and Tweuve- 
Ybaii Lisveb9 in tub PROJficnviJ Test op Uacuii 
Attitudes* 



m. of 

Reuc. to 



Ending 


Env. 

Env. 

Adoq. of 

Ending 

Thome 

Age 

Frus¬ 

Frus¬ 

Vr. Char. 

Hero 

Un.satis- 

Levels 

trating 

tration 

Superior 

Defeat 

faotory 

12 

4.05 

5.67 

6.00 

2.49 

4.8G 

8 

3.97 

6.33 

4.38 

2.64 

4.42 

4 

.58 

.08 

.81 

2.74 

.01 


♦ DifTerenco indicftltw greater reaction in BpanisU-Anglo RilimlionH, 

With reforonc-o to Tahlo T it U riuitc evident that wliat happoiiH 
in tlio toraponil interval between the fourth and eightli years 
contributes mucii more io development of racial attitudes tlian 
the subsequent years studied. It is observed, too, tliat tlie 
organism’s tendency to react to the environment in a manner 
betraying frustration mamfeata the greatest change in tlic first 
four years. It is important to note that tins category is one 
of the moat highly related willi the total projmlico score and 
therefore is one of the most indicative of prejudice. 

In both the Spanish and Anglo groups it is seen that the Spanish 
hero is defeated in the Spanlsh-Anglo situations as freriucntly 
at the four-year level ns at the two older age levels. At uU ago 
levels the hero or character with whom the suhicct identified 
himself is defeated more often in the not same group than he is in 
the same group, lb is possible to present tho hypothetical 
explanation with reference to this rinding Uiat, though tlio result 
is the same, the cause may aviso from different sources. With 
rofovonco to this finding, defeat of the principle character by a 
member of tho other ethnic group may be considered a criterion 
of prejudice. 
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Table II prcsenta tlie significance of the difference between 
same group and not same group of total Spanish subjects at the 
chosen age levels. The analysis includes: Effect of Environment, 
(Neutral); Adequacy of Principal Character (Equal); Ending 
Hero, (Indeterminate); Ending Theme, (Indeterminate). The 
difference indicates greater reaction in the Spanish-Spanish 
situations. 

Table II.— Significance op Dippeeengb between Spanish- 
SPANISH AND SpaNISH-ANQLO RESPONSES UsiNG TiIIBTY 
Spanish Subjects in Each Age Group Neutrality 
Categories* 



[Eff. of 

Reac. to 

Ending 

Ending 

Age 

Env, 

Env. 

Hero 

Theme 

Levels 

Neutral 

Equal 

Indeterminate 

Indeterminate 

12 

-3.21 

9.61 

7.79 

1.61 

8 

3.31 

9,03 

7.12 

1,18 

4 

.23 

2.19 

1.62 

0 


* DifTeronco indicates greater reaction in Spaniah-Spaniah aituationa. 


A neutral, equal, or indoierminate response displays absence 
of affect to the specific situation. Though those particular 
categories do not reveal the direction of prejudice swing, they 
do demonstrate positive or negative reaction to the depicted 
situation. In Table II it is noted that the shift from neutrality 
in the Spanish-Spanish categories to positive or negative reaction 
in the Spanish-Anglo categories has a marked relationship with 
age. 

Reflecting the organism’s tendency to be affected by the 
Spanish-Anglo environment in either a positive or negative 
manner, the neutral column shows the greatest difference between 
Spanish-Spanish and Spanish-Anglo categories. This factor 
would possibly indicate that discrimination of and sensitivity to 
different aspects of the environment arc prerequisite to more 
complex prejudice manifestations. It has been found that there 
is a positive relationship between prejudiCG and ability to recog¬ 
nize stereotypes.* 

In 'Ending Theme,' (Spanish-Spanish), because no indeter¬ 
minate responses were elicited at the four-year level (though 
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there were six at the Spaniah-Anglo level) no critical ratio coukl 
bo ascertained. 

The critical rtvtioa in Table III represent the Hignificanco of tho 
dirforencG bebu'con Si)aniali-SpaniHh ami iSpanish-Anglo rosponses 
for tho Spaiiinh ago levels. 'l1ie dinereneo inclicatoo greater 
reaction in the Spanish-Spanish catogorios in tlio ' lOffect of 
Knvironment,' 'Ileaclioii to Kiiviromnent,' and M'inding Tlicmo.' 
It indicates groator reaction in the Spanisli-Ajiglo categories in 
tho 'Adequacy of the Priaciplo Oharactor/ and ‘Ending Hero.’ 
Tho cntilyttis included; Effect of Environment, (Ilolpful), Ileac- 
tion to Knvironment, (Satisfactory); Adequacy of Principle 
Cliaractor, (Suhordinatc); Ending Hero, (Victory); ICnding 
TJiomo, (Satisfaotori'-)' 

Ta-ulk IIL— SiaNiFicANCB OF Diffbrbnck bktwebn Spanisu* 
apANiBu AND Si’ANtsii-ABato Hehponbks UstNd Thiuty 
Spanish Sunjicora in Each Aqb Guoup in tub Piiojec- 
TiVB Test of Uacial Attitudes 




Itoac. to 

Adcq. of 


I'lnding 


Eff. of 

Env. 

Pr, Char. 

Ending 

Theme 

Ago 

Env. 

Satis¬ 

Subor- 

Hero 

Saiia- 

Levels Helpful’*' 

factory* 

dinatef 

VicLoryt 

faelory* 

12 

-1.89 

-O.QG 

3.76 

6.66 

-4.82 

8 

-1.47 

-6.33 

3.50 

4.25 

-4.65 

4 

- .71 

- .68 

2.58 

.16 

-1.67 


* DifFcroiico indientea greater reaction in Spanish-Spanish situnUonB, 
t Difforonco indicates greater reaction in Spaniah-Anglo sitiiationa. 

With roferGiiCG to the data in Table III, it is noted that only 
Ending Hero, (Victory), and Adequacy of Principle Cliaractor 
(Subordinate), have more positive reaction in the Spanish-Anglo 
situation than in the SpanisU-Spamah. This means, then, that 
both aseendanco and BubmiBsion become more manifest svith ago 
and may bo consiclorod criteria of prejudice. Tliough subordina¬ 
tion of tho hero in tho Spanish-Anglo situation does develop 
with ago, the difference is already statistically signifioant at tho 
four-year level. Evidently, this feature is one of tho first to 
develop with ego ovolvomcnt and group identification. 

As ago inoreasoSj it is noted, tho reaction to the Spaniah-Anglo 
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environment becomes less satisfactory as does the feeling that 
elements of this environment are helpful. The ending of the 
theme also ends less optimistically. 

Anglo .—The previous data demonstrated the phases and 
characteristics of attitudinal development of tho Spanish sub¬ 
jects. The following analysis illustrates how and in what 
different age levels the Anglo attitude develops in adjustment 
to the Spanish. 

Table IV presents the significance of the difference existing 
between Anglo-Anglo reaction and Spanish-Anglo reaction of the 
total Anglo group. This table includes: Effect of the Environ¬ 
ment, (Frustrating); Reaction to Environment, (Frustration); 
Adequacy of Principle Character, (Superior); Ending Hero, 
(Defeat); and Ending Theme, (Unsatisfactory). 

Table IV.— Significance op Dippehencb between Anglo- 
ANQLO AND SpaNISH-ANGLO RESPONSES UsiNG TiIIRTY 
Anglo Subjects in Bach Age Group on the Projec¬ 
tive Test op Racial Attitudes* 



Eff. of 

Reac, to 



Ending 


Env. 

Env. 

Adeq. of 

Ending 

Thome 

Age 

Frus¬ 

Frus¬ 

Pr. Char. 

Hero 

Unsatis¬ 

Levels 

trating 

tration 

Superior 

Defeat 

factory 

12 

6.27 

G.16 

7.96 

2.32 

6.34 

8 

1.86 

3.06 

3.37 

2.10 

5.63 

4 

1.84 

2.07 

2.03 

1.68 

4.78 


* Difference indicates greater reaction in Spanish-Anglo situations, 


It is noted, with refercnco to the foregoing table: 

1) The four-year Anglo is more biased in his attitude toward 
the Spanish than is the Spanish of tho same age group toward the 
Anglo. It is apparent that the Anglo’s concept of the Spanish 
becomes negative earlier in life than tho Spani.sh’s toward the 
Anglo. This is concluded though it is realized that the average 
Anglo child of four years has had loss intercourse with Spanish 
than the average Spanish of that age has had with Anglos. 
Evidently, tho exaggerated attitude on the part of the Anglo 
with little experience concerning the Spanish has arisen from 
some source other than direct contact. 
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2) Though the four-yGar Anglo was more preividicccl in his 
attitude toward tho Spanish than the Spanish at tliat age level 
was toward the Anglo, little development between the fourth 
year and the cightli year was observed in Anglo nllilutle. This 
finding was in counterdtBlincUon to the Spanish developmental 
curves whicli noted Llioir grentoat increment during this period. 

3) Tlic Anglo critical ratios between same and not name situa¬ 
tions was greater at the twelve-year love! tliun the Spanish 
(though not significantly so-—C.U. = 1.211, aignificant at .20 
level). 

Furtlicr analysis was possible only after all categories had been 
analyzed. 

Table V represents diffemncca in reaction to Anglo-Anglo and 
Spanisli-Aiiglo stimuli with respect to neutral unci ocpinl cate¬ 
gories. As previously pointed out, ecjuuUly and ueutmlity arc 
manifestations of luck uf emotional arousal and bias. 


Tadlb V.—Significance op Diffeubnck uktwkkn Anglo- 

ANGLO AND SpaNISU-ANOI.O ReHPONHKH IJrtINd 'riUllTY 

Anglo SuiajECTS in Each Age Guoup on the Puojec- 



TLVE 

Test of Uacial ArriTUDEa 

* 


Eff. of 

Adeq. of 

Ending 

Ending 

Ago 

Env. 

Pr. Char. 

Hero 

Thome 

Levels 

Neutral 

Equal 

Indeterminate 

Indolerminato 

12 

3.32 

10.87 

9.53 

1.54 

8 

.79 

6 .GO 

5.09 

0 

4 

1.55 

2.68 

2.88 

.38 


* DifTorcnco indicates greater reaction in AngIo*Anglo siliiations. 


It may be remarked from the foregoing data that neutral 
responses elicited from the Anglo group to the Anglo-Anglo 
situations became progvoBsivcly weighted in comparison with the 
Spanish-Anglo situation in the older age levels. This is indica¬ 
tive, as previously suggested, of tho increased emotional arousal 
of tho older subjects to the Spanish-Anglo situations dei)icled. 

It is noted that the adequacy of the hero figure, closely par¬ 
alleled by the ultimate outcome of the hero, is most precipitous 
in loss of neutral reaction. 

Ending Thome, (Indeterminate) is incomplete at tho eight-year 
level because no response was observed in the Anglo-Anglo cate- 
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gory though there were aevea at the Spaniah-Anglo level. In 
this situation the satisfactory ending (Spanish-Anglo) may be 
less weighted with emotion^ factors than the indeterminate 
category, 

Table VI presents the signiAcancc of the difference manifested 
by the Anglo aubjeota between response to the Anglo-Anglo and 
response to the Spanish-Anglo stimuli. The categories under 
consideration are: Effect of Environment, (Helpful); Reaction to 
Envii’onmentj (Satisfactory); Adequacy of Principle Character, 
(Subordinate); Ending Hero, (Victory); and Ending Theme, 
(Satisfactory). The difference indicates greater reaction in 
Anglo-Anglo categories ‘Effect of Environment/ ‘Reaction to 
Environment/ and ‘Ending Theme.’ It indicates greater reac¬ 
tion in Spanish-Anglo categories in ‘Adequacy of Principle 
Chavactor’ and 'Ending Hero.' 

Tabl^ VI,— SiONiPiCANCB OP Dippeuencb between Anglo- 

ANGLO AND SPANISH-ANGLO RESPONSES USINQ TiUBTY 

Anglo Subjects in Each Age Group on tub Projec¬ 
tive Test op Racial Attitudes 




Roac. to 

Adcq. of 


Ending 


Eff. qC 

Env. 

Pr. Char. 

Ending 

Theine 

Age 

Env. 

Satis¬ 

Subor- 

Hero 

Satis¬ 

LovoU 

Helpful* 

factory* 

dinatet 

Victory t 

factory* 

12 

3.33 

0.16 

2.87 

7.99 

0.64 

8 

.019 

3.04 

2.91 

3.77 

6.42 

4 

.005 

2.07 

.01 

.02 

4.99 


* Tho clifferonco indicates a greater ronotion ia Anglo-Anglo situations, 
t The difCcronco indicate.'j a greater reaction in Spanish-Anglo situations. 

It is observed from the data in Table YI that victory and sub¬ 
ordination arc more prevalent in the Anglo’s reaction to Spanish- 
Anglo situations than to Anglo situations alono. This finding 
parallels that derived from tho Spanish data and the conclusions 
from these data, that ascendance and submwsion arc both mani¬ 
festations of prejudice, apply to both ethnic groups. 

OLDER COMPAUEU WITH YOUNGER IN EACH AGE QROU? 

It is evident from the foregoing analysis that the formation of 
attitude docs not progress at a uniform rate. The Spanish 
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between, four and eight yeara of age and the Anglos between 
eight and twelve manifcHt a marked increase in development over 
that found in other ago levels. Kvidcnllyj too, thero is n period 
of acceleration jiarlicularly at the Anglo level l)Gfore the four-year 
level. 

The irrcgulavities of growth mamtcKtod in the do.velopmental 
curves dninonstrate the impassibility of utilizing extrapolation for 
prediction, Ihough intorpoliilion is necassiirily and legitimately 
used. TJin only ioclmiciuo whieh could bn employed to ancertain 
attiludinal dovclopment below the four-year level was to com¬ 
pare the younger members with the older membevs in each age 
group. Tliis was sigiiincniit only at the four-year level, but the 
other levels wore analyzed, loo, to note fluotuation wliich would 
aid in interpreting tiie Hiulings at the early age levels. 

The Lcchniciiio employed was to dichotomize each age level of 
each ctlniio group by using ns namploa the twelve older and the 
twelve younger subjects. It was I'ciilizcd that the small sample 
would preclude accentiintcd flucluaiionH. 

Because of the small sampln, inconsislem-MOH were manifest, 
but it was noted, however inconclusively, that the Spani.^h and 
Anglos at the thrce-and-onc-halt age level vatbor eouHistenUy 
elicited less dKTcrenco between reaction to same group and nob 
same group stimuli. TIhs would indicate lliat, in one year, a 
measurable incromont in altitudinal dcvoloi)mcnt is manifest 
in botli ethnic groups. The data suggest that the origin of 
Spanish prejudice appears to be very close to the threc-and- 
onc-half ago level while the genesis of the Anglo appears some¬ 
what before this time. 

SUnjECTS WITH BPANIBII PAUENT and ANGLO PAUENT 

An interesting indication of accentuated prejudice wa.s mani¬ 
fested upon analysis of six subjects who liud one Si)iini8li and one 
Anglo parent. Thougli the number was small, it was found that 
the subject’s frustration and concomitant aggrossion in the 
situations depicted wci-c higher than the total for the specific 
ago group. Tlio general prejudice scoro, too, was higher toward 
one ethnic group or the other. An attemijt was made to ascer¬ 
tain the factors contributory to swing direction. 

At first it was hypothesized that the subject adopted the atti¬ 
tude of the dominant parent. This was borne out by the subjects 
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usually being prejudiced for the ethnic group to which the father 
belonged. In one situation, however, it was found that two 
brothers (eight and twelve) who lived together had opposite 
swings of prejudice. It was tentatively concluded with reference 
to this one situation, at least, that the subjects with one Anglo 
and one Spanish parent were prejudiced in the same direction as 
the parent with whom they identified themselves. This was 
borne out by subjective evaluation and may possibly explain the 
rather high relationship manifest between parent dominance and 
attitude. It was also noted that there was a tendency for the 
subject who had identified himself with the mother to have the 
girl as heroine in the boy-girl situations of the Projective Test 
of Racial Attitudes. 

The accentuated aggression pattern might be attributed to 
tension resulting from conflicting tendencies. 

SUMMARY OF FINDINGS IN DEVELOPMENTAL ANALYSIS 

Both ethnic groups manifest a clear picture of development of 
racial attitude from the early age levels to the older. Though the 
attitudinal development of the two groups varied qualitatively 
and quantitatively, a parallel growth was still in evidence. 

An evaluation of the areas of personality studied demonstrated 
that eacli revealed either positive or negative prcjiidico. Inter¬ 
estingly enough it was ascertained that both superiority and 
submission, defeat and victory aro expressions of prejudice— 
different patlorns of attempt to adjust to conflict. 

Qualitatively analysis at the twelve-year levels does not reveal a 
marked difference. Quantitatively, however, the Anglos appear 
more prejudiced than the Spanish though not significantly so 
(critical ratio at approximately .25 level of significance). 

It is interesting to compare quantitatively the differences in 
attitudinal growth between the Spanish and Anglos at the 
selected age levels. Tlie Spanish at the four-year level appeared 
less prejudiced than the Anglos of the same age (significance of 
the difference at .26 level), but during the ensuing four years this 
negative attitude developed to n level approximating that of the 
twelve-year-olds of that ethnic group. In distinction to this 
sequence of growth, the Anglo attitude developed little between 
the fourth and oightli years. Rapid acceleration, however, 
during the next four years (corresponding in developmental 
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progress to the Spanish four- to eight-year period) put the Anglo 
at tho highest level of prejudice of all groups and ages studied. 

Qualitative analysis revealed features of ftttitudinal develop¬ 
ment for tho two ethnic groups which demonstrated Homolhing 
of the dynamics of personality adjustment and ilio rdlo of prej¬ 
udice in its function. It was prcviouHly mentioned in this 
study that tho Anglos at the four-year level had less acfjuaintance 
with Spanisli persons than the Spanish. Tho hypotiicsis was 
forwarded for o.\plauntion of this factor tlmt some vicarious 
experience with auggestivo qualities had colored the Anglo 
attitude toward tlie Spanish. 

Analysis of each category and the significance of ago on iUs 
development bring-s out some important differences between tlic 
Spanish and Anglo groups. Tho Anglo group showed tlie 
greatest development in tlic final dominance of tho Anglo over 
tho Spanish and in the superiority of the Anglo to th(5 Sjjanish. 
Contrary to this, tho Spanish displayed as the mo.st weighted 
factor in the total prejudice score tl»o mnnifostations of frustration 
in reacting to tho Anglo environment and in ultimate victory of 
tho Spanish. Evidently, tho Spanish were loss assui-cd of their 
superiority than wore the Anglo and used aggression as an 
adjustment attempt. This finding was supported hy sul)jocLivo 
evaluation. 

In both tho Spanish and Anglo groups, defeat of the character 
with whom tho subject identified himself in tho stoi'ics was a 
manifestation of prejudice since it occurred more frcciuently in 
tho Spanish-Anglo situations than in the same group situations. 
Tho origin of its development, however, is little understood. 
In both ethnic groups it appeared as an almost constant jjositive 
factor througlioub tho ago levels. Evidently, tho genesis of 
this factor was at a very early age and it reached tho twelve-year 
maximum before the ago of four. 

Tho data indicated that the Anglos wore loss optimistic about 
the Spanish-Anglo relationship than were tho Spanish. The 
Anglos appeared to bo tho aggressors and tho Spanish merely 
attempting to adjust to this aggression. Tlio comparison of 
satisfactory and unsatisfactory endings of tho themes, tho early 
development of Anglo ntliludo, superiority and dilTorenC rates 
of prejudice development would demonstrate tliis. Tliose 
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criteria indicated how the instilled attitude of one group may 
contribute toward the attitudinal development of the other. 

The younger subjects at the given age levels were analyzed 
independently and compared with the older subjects from the 
identical age group to ascertain the effect of one year on atti¬ 
tudinal development. The results indicated that, primarily 
at the four-year level, a measurable increment in prejudice was 
manifested in both ethnic groups. The data suggested that the 
origin of Spanish prejudice appeared to be very close to the three- 
and-one-half-year level while the genesis of the Anglo appeared 
somewhat before this time. 

An interesting indication of accentuated prejudice was mani¬ 
fested upon analysis of six subjects who had one Spanish and 
one Anglo parent. Though the number was small, it was found 
that the subject’s frustration and concomitant aggression in the 
situations depicted were higher than the total for the epecifio 
age group. The general prejudice score, too, was higher toward 
one ethnic group or the other. An attempt was made to ascer¬ 
tain the factors contributory to swing direction. 

In one situation, it was found that two brothers (eight and 
twelve years of age) who lived together had opposite swings of 
prejudice. It was tentatively concluded with reference to this 
one situation, at least, that the subjects with one Anglo and one 
Spanish parent were prejudiced in the same direction as the 
parent with whom they identified themselves. This was borne 
out by subjective evaluation and may possibly explain the rather 
high relationship manifested between parent dominance and 
attitude. It was also noted that there was a tendency for the 
subject who had identified himself with the mother to have the 
girl as heroine in the boy-girl situations of the Projective Test 
of Racial Attitudes. 

The accentuated aggression pattern might be attributed to 
tension resulting from conflicting tendencies. 

itSFEmENcn 

1) Franz, Boaz. Race and Democratic Society. New York: 
J. .1. Augustin, 1946, p. 27. 



VERBAL INTELLIGENCE AND EFFECTIVENESS 
OF I^AimCIPATION IN GROUP DISCUSSION* 

nouman e. green 

Mnjor, PSAF, Crnig Air Force Rose, Sclrnn, Alftbnma 

This rcpoi’t is a part of a broad ntiuly of tlio factor of verbal 
inlelliKoncc or vocabulary power in Air Force teacher Lruiniiig. 
The invcstiRalion is heing made at the, Aciuleiuic Instructor 
Division in tlie IJSAF Special Staff School of the Air University 
whore a six-week instructor training course is presented. The 
test groups for the over-all study were two classes of Air llOTC 
instructor trainees, totaling two hundred fifty-two members. 
Tlie population for this part of the study was ono class of one 
hundred twelve of the Air ROTO instructor trainees. 

Because conference methods of instruction were being taught, 
it was felt that it would be valuable to identify some of the factors 
which contribute to cffectivonosa of participation. Sinco it 
BccmB logical that voeaUulavy power might have some Imaring 
on success of conferees, thia factor was investigated. In addi¬ 
tion, as mentioned below, inalrucliun was carried out in small 
groups Ihrougliout the course, and the opinion was that for 
purposes of this school, the groups should Im arranged lielcro- 
goncously according to indicated effectiveness or capacity to 
succeed, Fuvtlicrmorc, an ovganismic interpretation of ciualita- 
tivo learning in cooperative group activities demands a holero- 
goneoua arrangement of cxperieiiccs. Such a situation gives 
potential basis for optimum interaction tintl individual growtli. 
Thus, if verbal inlelligonco could be found to liavo rolationsliip 
to elToctivoness of participation, it would have value as a criterion 
for arranging the groups in a manner which tends toward maxi¬ 
mum learning. The problem represents an attempt to isolate 
and describe the relationship of one factor within a ‘field' sur¬ 
rounding an organic group learning proeess. 

The major part of the instruction and all of the practicc- 
toaohing exorcises within Iho Acadomic Instructor Course are 
conducted in groups of about ten student-instructors. In the 
unit of instruction called Conference Methods of Tcaeliing, witlr 

*'IhoaulliOT wiahes tottianlcDr.H.li.T]iiormViko, Dr. Joaopb 10. Barmnok 
and Dr, Herman Foifol for thoir ndvico and construcUvo criticisms. 
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irhich this paper is conoerned, there were seven groups of ten 
members each and two groups of nine members each. These 
groups were in session for approximately ten hours of problem¬ 
solving discussion centering about such issues (chosen by the 
students) as, “What Can Be Done to Improve the Airman Infor¬ 
mation Program?”; “How can We Curb Sex Laxity in American 
Collegca?”; “What Improvements Can We Make in Evaluation 
of Officer Effectiveness?” During the ten hours, each group 
was under the guidance and observation of one faculty-adviser 
for the first half of the session and another faculty-adviser for 
the last half of the session. 

The procedure, then, was to organize each one of the nine 
groups of conferees for the ten hours of problem-solving discus¬ 
sion heterogeneously according to scores obtained on two verbal 
intelligence tests. The tests used were twenty-word, stooply- 
gi'flded, multiijJe-choice type. The words were taken from the 
I. E. R. Intelligonco Scale CAVD. These were the same instru¬ 
ments reported on by Thorndike and Gallup in a survey of the 
American voting population,* and earlier by Thorndike alone.® 
This system of deLermining group membership, having a balanced 
number of high, intermediate, and low scores in each group, thus 
equalized the groups as far as tliis yardstick of verbal intelligence 
was concerned. 

There were twenty-four judges involved in the experiment. 
These were regular stall members of the school. Each one had 
had considerable experience with conference methods of instruc¬ 
tion, both as participant and as critic teacher, Two observed 
each group. During the time they were observing the groups in 
discussion, the faculty-advisers did not know that they would 
later be asked to give their opinions about the effectiveness of 
the conferees. Noi’ did they have knowledge of the vocabulary 
scores received by the group members. 

On tlie day when this discussion phase was completed, each 
inslnicior involved was given a written memorandum on which 
he was asked to submit the names of three student-instructors 
whom he considered to be most effective as conferees during the 

'"Verbal Inteliigcnco of tho American Adult," II. L. Thorndiko and 
G. II. Ctillup, Journal of General Psychology, Vol. 30, Jan,, 1044. 

*‘‘T\vo Scrcciting Testa of Inteliigcnco,” R* 1». Thorndike, Journal of 
Applied Psychology, Volume 20,1042. 
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periods he ohserved the group. In order to detorraino this 
judgment, they were asked to concentrate upon tlioso who par¬ 
ticipated most frequently and at the same time gave good qual¬ 
ity contributions. Tlicy were to name those three conferees in 
order of efTcctivcnc.S3. In addition, they wore aslced to submit 
tho names of threo confcrcea whom tliey considered to he least 
effective. Heticcnco was the principal criterion for determining 
this. Tlie three least efTcotivc were also to be named in numerical 
order. It i.s the writer’s opinion that, in view of tho c.\tonded 
oxpericnCG of the faculty-odvisera with this conference method, 
the ToquGslcil criterion of elTectivencss of participation Nvaa a 
sound one. The judges were particularly aware of tho dangers 
wliich develop tlirough dominance of the discussion by one or a 
few members. And they rccogniacd the benefits of constructive 
contributions, frequently termed ^committee work.' 

When tho name.s of Uio most effective and Icost olTectivo par¬ 
ticipants in each of tlic twelve groups were received, a point 
scoring system was established. A conferee named most cfTcc- 
live of the entire group received a score of plus 3; one named 
second most elTectivo received a score of plus 2; nud Uio one 
named tliird most olTeotivc of cacli group received a scorn of plus 
1. The same scoring waa used for the iciust effective memhers, 
except tliafc tho figures wore negative. Thus, if a conferee was 
named by eacli of tho two judges (who worked indoj)endcntly) 
as tho most offcctive of a particular group, ho would rcccivo the 
highest possible score, a plus 0. 

This scoring system, later used in the refinement of tho data, 
permitted an equitable discrimination among effectiveness in 
each group. It was thus possible to (1) pick out tho three most 
effective in each discussion group, (2) pick out the three least 
effective in each group, (3) pick out tho top most effective par¬ 
ticipant in each group, (4) pick out the one reprc.scnting least 
efCectivcticsa in each group, (5) arrange the members of each 
group in rank order of eficctivenoas, and (b) through an adjuat- 
raent of the raw scores, to compute a product-moment correlation 
coefiicient between olTcctivcncss and verbal intolligonco for tho 
whole group of fifty-four particlpairts who wove named on tho 
cffcctivenose scale. 

From this point on, tho experiment and treatment of Llio data 
were further organized into two phases. Tlio first was an 
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attempt to establish a statistical relationship between verbal 
intelligence and effectiveness of oorifereea. This included the 
assemblying of the vocabulary scores of those named in the top 
bracket of effectiveness in all the groups (N = 27) and all those 
named in the least effective bracket (N = 27). It also included 
assemblying the vocabulary scores of the nine conferees named 
first in effectiveness of participation and the scores of those nine 
conferees who were named as representing the least effective 
member of each group. 

Table I presents the statistics for two larger groups, and shows 
the significance of the difference between the two means. 

Table I.—SiaNirrcANCB of tub Difpeeence between the 
Mean VocAntrLAnY Score op the Most Effective Par¬ 
ticipants IN Group Discussion and the Mean 
Vocabulary Score of the Least Effective 
Participants 




Mean 

Standard 


N 

Vocab. Score 

Deviation 

Most Effective (X). 

.. 27 

29.77 

4,4 

Least Effective (Y). 

. . 27 

26.29 

3,0 

%-Y . 


... 3,48 


Standard Error of Difference... 


... 1.14 


Critical Ratio. 


... 3,05 



The null hypotheses, that there is no true difference in verbal 
intelligence as measured by this yardstick between the most 
effective and least effective participants, is rejected nt the .01 
level of significance. 

In dealing with the smaller groups in a similar manner, the 
small sample theory and formula were employed in the refine¬ 
ment of the data to determine the statistical significance of the 
actual difference of six points between the means of the two 
groups as shown in Table II. 

In this case, the difference is significant at the .03 level. 
Results obtained from the two treatments of the data sIioav that 
a true difference exists in the groups and the difference is not due 
to chance, 

Thus, from the first phase of the study it was evident that n 
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Table II.—Significance of the Difperenck between tue 
Mean Vocabolaby Score op the Topmobt Effective 
Participants of Each Discussion Group and the 
Mean Vocabulary Score op tub rAUTiciPANTS 
SiiowiNO Minimum Kppkctivenehh 

Moan Standard 
N Voca)). Score Deviation 


Participants with Maximum ElTcc- 

tivonoss (X). 9 

Participants with Minimum Effec- 
tivonesa (Y)...9 

X-V. 

Standard Error of Difference. 

Critical Patio. 


31.00 

4.4 

25.00 

5.3 

. 0.0 


. 2.43 


. 2.88 



statistical relationship existed. In phase two, an attempt was 
made to discover more about the degree of rclationsliip. 

Table III represents a breakdown of each of the nine groups 
showing that williin each (except group #0), there was a di(Torenco 
in 'vocabulary power* consiBtcnUy in favor of those named as 
effective participants. The range of the differences is from zero 
difforcnco in group 9 to a difference of 7.07 points in group 2. 
The mean difference is 3.48. 


Table III.— Difference in Mean Vocaiiulauv Scores of 
Most Effective and Least Effective Participants in 
Nine Discussion Groups 


Group............ 

1 

1 2 

3 

4 j 

0 


7 

8 

0 

Mean Voenb. Score 
of most eftcctivo' 

31.07 

82.33 

31.07 

MB 

20.00 

28.33' 

27.00 

30.33 

20.33 

Moan Vocab. Score 
of Least Effective 

27.33; 

24.00 

28.00 


24.00| 

27.00 

27.00 

27.00, 

20.33 

Diffcronco. 

4.34 




6.00 


0.00 

3,33 

0,0 


Table IV presontB, for each discussion group, the ranlc-dilTor- 
ence correlation coafficient between the inemhors' offcctivcness 
scores and thoir scores in verbal intelligence. All groups had 
ten members except groups 7 and 9, which had nine mombora 
each. Although all coefffeients are positive in a range from 
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Table IV.—Rank Pjekebencus Coerelation Coefficients 
BETWEEN Verbal Intelligence and Effectiveness op 
Participation fob Nine Discussion Groups 


Group . 

1 

2 

3 

4 

6 

0 

' 7 

8 

0 

Rank Corre¬ 

lated Coefficient 

+ .29 

-h.57 

+ .30 

+ .40 

+ .62 

+ .10 

+ .27 

-f-.30 

+ .09 


+ .09 to +.57 (mean coefficient is +.32) the small samples 
involved precluded any proof of statistical significance. 

In the final treatment of the data, tlie effectiveness scores of all 
fifty-four participants representing the top and bottom brackets 
of each group were paired with the vocabulary scores in a compu¬ 
tation of product-moment correlation. This coefficient was 
found to be +.45, with a standaixi error of .10, representing a 
correlation value significantly larger than zero at the .01 level. 

Although these coiTelations are not of high ordei’, they indicate 
that a positive relationship is present to at least a fair degree. 
A comprehensive interpretation would not fail to take cognizance 
of other seemingly obvious factors having influence on one's 
ability to participate effectively. Some of these might be 
familiarity with the topic of discuswon, interpersonal relation¬ 
ships in the group, motivation and general interest. If these 
factors also are of importance, then the consistent positive sta¬ 
tistics in favor of verbal intelligence may give greater reason 
for attaching a relative value to this latter variable as one 
concomitant. 

These results might then be construed to demonstrate that 
verbal intelligence was a contributing factor to effective par¬ 
ticipation. Practically speaking, this means that the adminis¬ 
tration of these instruments and the use of the scores may serve 
as a valuable aid in setting up small learning groups balanced on 
the basis of the ability of the conferees lo participate. A con¬ 
tinuation of the investigation of effectiveness in group proce-sses 
must be dirccLcd toward study of other probable attending 
faefeoYs indicated above. Beyond this, further research may 
reveal additional educationally significant relationships between 
scores on these tests of verbal intelligence and capacity to per¬ 
form successfully in other teaching-learning practices. 
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WiLLAUD L, Valentink AND Delob D. WicKENB. Experivtenial 
Fowidalions of General Psychology. Third Ed. New York: 
lUnelinrt and C'o., 19i0, pp. 472. 

ThiH tlhrcl edition ia a rallier thorough revision of a text wliicU 
has liad wid(5 iiHago ainee llio apponranco of tlio first edition. 
Ncvortholcss, tho general patlorn of Uio text is Lho samo. In 
cacli cha))tor thoro is a preliminary orientation to tho subject 
mutter and problems plus dcfiniliouB and in some cases method¬ 
ology. This is followed by selected investigations in condensed 
form which usually include introduction and hypothesis, method, 
results and a summary of interpretations. There is also a 
summary of the chapter. Throughout llie book thoro is some 
omplmsis upon correcting misconceptions about the nature of 
psychology, and tho inclusion of maloriulH whicli Imvo a part in 
“determining tho liieoretical Blruclui-o of modern j)8ycliology.** 

In tiiis revision tlioro is a now eliapler on personality. Most 
of the material on perception is new, and tho chapters on condi¬ 
tioning and learning are drastically rovisod. In most of tlio other 
chapters now oxpovimenU have been added or substituted for 
material omitted. In all Uio revision the selection of material 
and discussions have been centered on tho more recent trends in 
t)io field. In particular thoro aro new maloj’ials on social reac¬ 
tions and reports of investigationu done by military psycliologist-s. 

It is stated that tlie book is "concerned principally witli psy¬ 
chological facts and principles on wliich thoro is a majority, if 
not a universal, agreement.’' Some sections found in psychology 
texts are not included hero. No particular system of psychology 
is emphasized. Thoro is, however, ompha-sis upon utility and 
applications. In gimoral, tho materials indicate how a psycholo¬ 
gist collects infoimiition ho needs and iiow ho intori)rcl3 the data 
collected. Tho book is designed as a supplement to standard 
texts. 

Most I'cadons will agree that tho soloction of oxporimentfi Ims 
been done with dlscrlTnination. NovorthclesH some may consider 
tliat in too many instances animal rather than human oxperi- 
menlg w<iv6 chosen. Eurthovmovo, if contemporary trends aro 
to be emphasized, tlio material on perception could have been, 
both broader and more extensive. 
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Tho material throughout the book is interesting and is con¬ 
cisely and clearly presented. It would appear that the avowed 
aims have been adequately achieved. It is noteworthy that the 
figures and typography are excellent. There can be little doubt 
that this revision will be popular and enjoy wide usage. 

Miles A. Tinker 

University of Minnesota 

SusA-N Deri. Inirod/action to the Szondi Test, New York: Grune 
and Stratton, 1949, pp. 364. 

Mrs. Deri’s familiarity with the Szondi test extends over a 
period of about eleven years, tho first four of which were spent 
working closely with Dr. Lipot Szondi in the early applications 
of this method to personality diagnosis. Dr. Szoncli’s highly 
laudatory Foreword is confirmation of tlie authority with which 
the author writes. 

Tho Szondi test consists of forty-eight photographs of mental 
patients. These fall into six sets each containing eight pictures; 
one each of a homosoxual, a sadist, an epileptic, an hysteric, a 
catatonic schizophrenic, a paranoid schizophrenic, a manic 
depressive dopressivo, and a manic depressive manic. One sot 
of photographs is displayed to tho subject at a time. From each 
sot the subject selects tho two pictures ho likes most and the two 
he dislikes most. When this process has been completed, the 
subject chooses from among tho twelve ‘most liked’ tho four 
for which he has tho greatest liking and from among the twelve 
disliked the four arousing the greatest aversion. These responses 
are transferred to an appropriate graphic record shoot. Tho test 
must be repeated "at least six, preferably ten, times, with at 
least one day intervals between administrations, to be able to 
give a valid clinical intorpretation of tlie personality." An 
optional extension, entitled tho ‘factorial association experiment,’ 
involves asking the subject to tell storioa about each of the eight 
picUiros finally chosen. 

Tho major portion of the book is dovoted to an exposition of the 
interpretation of scores. Ncod-tonaion is regarded as the driving 
force "in tho sense of directing the person to pcjlorm certain acts 
and to choose or avoid certain objects." The type of activity 
or object depends upon the kind of need. "Its field of applica- 
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lion 18 again similar to that of other projective tcchnicsj in other 
words, 08 a diagnostic instrument for clinical use or for the 
iutorprotation of the so-called normal personality, vocational 
guidance, experimental social psychology and a variety of fields 
of roHciireh." 

Mrs. Deri avoids an expression of allitudo toward tlio gono- 
thoory which this tost was originally inlcnded to 'prove experi¬ 
mentally.’ According to Saondi's Ihcoryj “the mental disorders 
reprcaonted in the test aro of goiiotic origin and tfio subject’s 
emotional reactions lo these photographs were believed to depend 
upon some sort of similarity between the g(;nc-struoturo of the 
patient represented by the photograph and that of tlio subject 
reacting lo the photograph.” Mrs. Dori takes the position that 
the test’s cITectivenoas has been established whether or not the 
early hypotlicKis is accepted. 

To the reader who is accustomed to look for experimental data 
in support of claims of usofulnoss or validity, this volume is 
wliolly inadequate. Elaborate explanations of the significanco 
of various factors arc given wiiliout oven freriuency tables. 
Sums, difforcnccs and ratios are computed and intcrjirolcd with¬ 
out thought for the problems of reliability involved. Shifts in 
type proforenco or aversion from one day to the next arc regarded 
aa indications of changes in the needs and tensionB of the subject 
rather than errors of moasuroment. Validity in tlic usual sense 
appears to be dismissed in the following paragraph. 

"Tho superficial appearance of normalcy is responsible for the 
oxtremo difTiculUcs inhorenlin tho problem of validating sLudica 
on the basis of observable behavior or verbal or written ques¬ 
tionnaires. Many basically unhappy individuals who are unable 
really to becomo emotionally attached lo any person or object 
would rate extremely high on a written adjustment inventory, or 
on the basis of observation.” 

This reviowor can only conclude that, on the basis of Mrs. 
Deri’s book, tho S'/ondi test is one more unproven instrument 
proposed as an aid in pcmonalily diagnosis. Pending the publi¬ 
cation of adequate supporting ovidonco, tho psychologist using 
this method is proceeding on the basis of faith and sliouid bo 
willing to rocognizo the peril of his course. 

GEOitQB K. Bennett 


The Psychological Corporation 
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THE DEVELOPMENT OP A FUNCTIONAL 
COURSE IN EDUCATIONAL PSYCHOLOGY 
FOR TEACHERS' 

HERBERT KLAUSMEIER 

Colorado State College of Education 
and 

DONOVAN SWANSON 
Ohico State CoUcgo 

As Trow has pointed out in an eai'lier issue of this Journal: 
"A visit to a school is still a saddening cxporienco to an educa¬ 
tional psychologist. With due respect to the many exceptions, 
so many things aro wrong, so completely wrong, that the visitor 
wonders what has become of all the well-established ‘principles' 
that the teachers and administrators supposedly learned in 
order to pass tho psychology courses required for their certifica¬ 
tion.”^ Ho suggests that improvements can and should be made 
at tlio source; namely, in organising and teaching the courses. 
The purpose of this paper is to pi-esent an account of a study to 
develop a functional course in educational psychology for 
teachers. 

PRELIMINARY CONSIDERATIONS 

Under tho leadership of Professor Lucion B. Kinney, a com¬ 
prehensive cuvriciihim development and evaluation program in 
teacher education was begun in 1947 at Stanford University. 


1 Ilorbort J. Klausmoior and Donovan A. Swnnson, The Develo-pimnt 
oj a Functional Courae in ISducational Paydiology for Teachera. Unpublislied 
Ed,P i Dissortabion, Stanford Univeraity, 1949. Tho writers nro indebiod to 
ProfosBorLvicien 13. Kinney, who served ns chairman of tho thesis committee. 

* William C. Trow. “How Ed\icalional I^chology and Child Develop¬ 
ment Can Contribute to the Preparation of Teachers.” Tho Journal of 
Educational Paychology. 39:120, March, 1048. 
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Ab part of this program, tho rolo of educational psychology in the 
professional seqiicnco wua Btudied. Tho foundations for tho 
study were laid in tho spring quarter of 19-18 wlion Professor 
Kinnoy tauglit tlic course and llio authors wore OHsistants in 
education. Tlie evaluation was carried on during tho autumn 
and winter quarters of 19-18. 

TIub Htudy was directed to the organization and evaluation 
of n courwi in (‘ducatioiud psycludogy designed for one quartor'e 
work, carrying four (piartcr-hourH of credit, reijuired of all stu- 
clenls seeking elementary- or secondary-school teaching creden- 
lialfi at Stanford Univoraity. Tho class population for tho 
autumn quarter consisted of one liundred sixtocn students; for 
iho winter quarter, aeventy-soven siudentH. Por both quarters 
approximately ono-hulf hud graduate standing; tho remainder 
wore undorgraduatCH. All students had completed a course in 
general psychology; in addition, clcmcntavy-school eivudidatcs 
had completed a courfio in child psychology. In setting up tlio 
study tho following major problems were defined and analyzed: 

1) What arc the compolonccs of effesetivo chussrooin teachers? 
An explicit definition of what constilutofl teat-lung compotonco 
is oBScntial in building a profcssionnl curric.ulum in teacher 
education. Unless tho hohaviora of ofToctive Leiu'hers are o))ora- 
tionaily defined in torma of teaching competence, ctmrses cannot 
be organized witli any degree of validity, nor cun the elTectiveneBS 
of Buch courses bo determined. The "Factors iir Teaching 
Compotonco” as defined by the California C'ouncil on Teacher 
Education is a comprohensivo etatomont of touching coin- 
potonco upon wluch tho professional program in teacher education 
at Stanford University is built.* 

2) Which teacher competences should bo dovolopod in educa¬ 
tional psychology aa part of the professional soquonco? Tho 
"Factors in Teaching Compotonco” provides tho objectives 
to bo dovolopod in tho total professional sequence. Tim I'csponsi- 
bility of each of Llio various courses was as-signod in Htaff con- 
feroncoB as tho sequence of courses was oBtahlishod. In this 
manner, integration ia provided for and duplioations and oiniH- 
sions aro avoided. 

• Committoo on Pofmition of Tcaohing Compotonco. California Council 
on Teacher Education, "Foctorfl in Toaohing Compotonco.” Mimeograph 
statement. Stanford University, July, 1048. 



Functional Course in Educational Psychology 


461 


3) In the pre-service education of teachers, what experiences 
should be provided in educational psychology to develop tho 
competences? Learning experiences provided should: (a) utilize 
the unique contributions of the field of educational psychology 
to effective teaching and incorporate the objectives of the course, 
(b) be organized according to a developmental sequence which 
illustrates psychological principlos of effective teaching, (c) be 
selected to illustrate the activities of the classroom teachers, and 
(d) utilize the resources of the public schools and the community. 

4) How effective are the experiences in developing teacher 
competonce? Evaluation is essential in curriculum development 
in order to determine (a) which competences are developed and 
to what extent, (b) which experiences are valuable in developing 
Gompotoncos and to what extent, (c) which procedures are 
effective, and (d) what are the implications for practice and 
improvement. 

Basic to this study was the assumption that teacher education 
is primarily an area of pei’sonncl development of which scholar¬ 
ship is one aspect. Thus, educational psychology is defined as an 
area of personnel development within tho field of teacher educa¬ 
tion in which resources and procedures from general psychology, 
human biology, and cultural anthropology are brought to bear 
upon classroom problems. A second assumption was that 
"Factors in Teaching Competence” as defined by the California 
Council on Teacher Education represents a workable hypothesis 
on which to build a professional program in toachor education. 
Therefore, the objectives for educational psychology can be 
drawn from tho " Factors in Teaching Competence” and defined 
oporaLionally in torms of teaching competence. 

To summarize, in setting up the program in educational 
psychology, this sequence was followed: (1) objectives in the 
course wore established in terms of student behavior indicative 
of teaching compotenco; (2) learning oxperioncos were tenta¬ 
tively organized to achieve the objectives; (3) sources of evidence 
to bo used in observing tho behaviors wore identified; (4) evalua¬ 
tion instruments and procedures were dovciopod for obtaining 
data; (5) tho data wore gathered, summarized, and interpreted 
to make tho best possible judgment concerning student attain¬ 
ment of tho objectives during tlio autumn quarter; (C) on the 
basis of tho evaluation during tho autumn quarter, certain 
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roviaiona worn made in objcclivca, courao oxporioncoa, and 
evaluation inatrumonta; (7) data were gathorodj summarizod, 
and intorpTctcd during t\io xvinlor quartnrj (S) on the iDosia o! 
the evaluation, auLumu and vintor, concliiaions woro drnwu and 
rocommondntiona raado. 

DEFINING OIUKOTIVKH IN KDIIrATlUNAL I'BYCJIDLOnY 

Agrocinont wna reached that the primary rcHiiouHibility of 
oclucational psychology is to develop the competence nocossary 
for the prospective tcaclior to organize learning activities in the 
classroom in ^vluell l)io toacKor: 

1) Adapts paychological principles of learning to individuals 
and groups, (a) Provides for individual capacities of pupils, 
(b) Employs adequate motivational procedures, (c) Organizes 
loarning oxporicncoa wliich possess meaning and structure for the 
pupil, (d) Uses cffoctivo practice procedures, (e) Selects and 
appraifwjs oxpcvionces in Usvins of their irimKfiM’ value. 

2) Adapts psycliolofdcal principloH of giowtli and dovolop- 
mont to individuals and grouiis. (a) Iiilori)r{4s i)ui)il Ijfduvvior 
in relation to iiia jircHoiit liluation ns 8iia])eci by pin I (‘Xperienco 
and aa influoncod by future oxpe.olulionH. (I>) Adapts (daasronm 
oxporicncoa to tho social backgrounds of the ))Ui)ils. (c) Inte¬ 
grates classroom oxpoiioncca with life in tho liomc. (d) Inlo- 
gratoB tho social dynamics of the classroom, (c) Develops in tlio 
classroom an atmoaphoro conducive to innutal liealth. 

3) Adapts paycliological principles of counseling and guidanco 
to individuals and groups, (a) Knows each iiupil ns an indi¬ 
vidual. (b) llocognizc.s range of emotional inaladjuatmontB. 
(o) Provides success oxporionccs for all pupils. 

4) Adapts psychological principles of evaluation and monsure- 
mont to individuals and groups, (a) Uses appvopriato tech¬ 
niques for evaluating tho cfTcctivcncsa of school loarning. (b) 
Uses appropriate techniques for moasuring nchiovomont. (c) 
Ubos grading system Nvith cloavly defined purposes. 

"Develops professional boliavior" is a fifth major objective 
Bliarod with all other professional courscH. 

After thoso gonorai objoclivos had been agreed ufion, spccilio 
aims for tho course wore devolopod. It was necessary tliat these 
aims bo sufflciontly comploto and doflnlto to orient tlio course 
experiences, tq direct tUo Bolcction of resources and matorials, 
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and to serve as the basis for evaluation. The criteria for specific 
aims were adapted from those developed by Kinney.* 

A. Validity .—Can the aims be justified on the bases of (1) 
social and professional needs of the students, (2) personal needs 
of the students, and (3) feasibility as determined by the possi¬ 
bility of attaining them? 

The pioneer work of the California Council may be considered 
as having tentatively ostablishod the social and professional 
validity of these aims. Furtlior validation has been obtained 
from the considerable body of research already carried out at 
Stanford University. While the personal needs of the students 
may be assumed to follow as a matter of course from the social 
and professional needs, the psychology of learning in general 
and of motivation in particular requires that the students accept 
the personal significance of the aims. 

Another important question in regard to validation of an 
aim is whether it can bo achieved with reasonable expenditure 
of time and ciTorb. The answer here can only be tentative. 
Only through Gxperionce in teaching the course can the feasi¬ 
bility of an aim be finally established. 

B. ConvprGhensiveness and Selectivity .—Do the aims include 
the outcomes of major importance and represent the unique 
contributions of the field, and dilTerontiate the more important 
from tho less important? 

Comprehensiveness and selectivity of the aims was established 
on tho basis of expert opinion and related research. 

C. Suilahilily oj Form .—^Tho final consideration was to state 
tho aims in a form which would bo useful as a basis for teaching 
and evaluation. Expreasing aims in terms of desired behavior 
has many advantages—it is simple, and it avoids verbalism, 
as well as the pitfalls of expressing outcomes in terms of traits. 
The criteria for form are: 

1) Can I recognize this compolonce in a student? 

2) Can I dillcvontiato a studont who has tho coinpotonce 
from ono who does not? 

3) What kinds of bohavior will distinguish tho student who 
has tho competonco from ono who does not have it? 


*Lucien B. Kinney. '‘Criteria for Aims in "Matliematics.’* The Mathe¬ 
matics Teacher. 41:99-103, March, 1048. 
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To tflke an illustration: Most cduealors ngroo that on impor- 
lont aim in educational psychology is to develop prospective 
toachenJ who arc competent to appraise llio rendincss of n pupil 
to learn a spociRc ability or concept. Slatod op(‘rationtUly, 
Uie proMiJcctivo leaclu^r who is compclont in this urea demou- 
atralos the following Iwhavlors: 

1 ) UndorslaiulH (lu^ major facloi's which dolorinino readiness 
to learn. 

2) Recognizes how pre-sont interest may bo used to motivato 
claaaroom learning. 

3) Doacribr.s suiVablo diagnostic techniques for dolormiuing 
readiness to learn a particular ability or concept. 

4) lUvaluaUis diagnostic jwocodurcfl ummI in tlin ela-sHroom. 

5) Plans learning oxporiencca which lake iuU^ account factors 
of readinosa, 

Tills alafcomont of operational dcfinilionH ilhiHtrates tlie extent 
to which one sul>-»cclion of aims under "I’rovidcrt for individual 
capneitioa of pupils” was delimilojl and defined. It ul.so iruiicutos 
the kinds of oxporicuces necessary to develop smh eoinpetcnco 
and BuggcBts arciui in which Bludcnt behavior may he. oUsevved 
and ovoluatod. Iloadinga, group discussions, ehivS.srooin visita- 
lioiiB, films and rosourco porsonnol, and lecLiire.s all (fontributo 
to the dovolopmont of these liehaviors. Making an ohserva- 
Uonal ease Btiidy of a school child also coiitrihutos to conipotenco 
in this area. Tho actual plaiihing of learning expiiriemufs which 
take into account factors of roadincss is suggested by the nature 
of the operational definitions. 

DEVELOPING TUB COIIUBB OllOANlZATION 

The ovor-£ill pailern of Uio course compi-ised live major areas: 

1) What contributions has educational psychology to success¬ 
ful teaching? 

2 ) Wliab is Iho typical soquonco and iialtorn of meaningful 
learning? 

3) What factors dotormino tho social clinmto of tlio classroom? 
What is tho significanco of those factors for tho Leiudior as an 
organiser of learning? 

4) How may the teacher use the rosourcc.s of tlio school to 
facilitate tho adjustment of the individual child? 
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6 ) How may the teacher evaluate the effectiveneas of hia 
work? 

The procedures employed in developing teaching competence 
as related to the first three major areas are illustrated below: 

1. 'What contributions has educational psychology made to suc¬ 
cessful teaching? (a) What is the nature of the field? (b) What 
contributions do the authors of tho textbooks claim for it? 

(c) With what kinds of classroom problems is educational psy¬ 
chology concerned? (d) What preparation do I as a teacher 
need irv this field? 

Tho purposes of this unit were: (a) to orient the student to 
the r61e of the teacher as an organizer of learning experience, 
(b) to provide a variety of motivational experiences for the 
major problems to be considered in this course, (c) to ensure 
student participation and acceptance of tho objectives, and 

(d) to determine student interest and needs. 

The students sought answers to the abovo problems in various 
activities. They .scanned the textbooks. They visited class¬ 
rooms in the public schools where they noted problems of organiz¬ 
ing learning and problems of classroom control which require 
tho use of principles of educational psychology. Information 
from those sources was brought together in small discussion 
groups which mot each week during the quarter. In tho first 
group mootings the students, on the basis of their experiences 
and with the guidance of tho instructor, considered: (a) What 
topics should bo dealt with in tho course? (b) What outcomes 
sought? (c) How should tho outcomes bo evaluated? 

From observations of public school classrooms the students 
derived a delineation of the scope and contributions of educa¬ 
tional psychology to efioctive teaching practices. They observed 
that the organization of learning experiences is tlie central 
activity of the teacher; and it was in the rdle of organizing 
learning experiences that they, as prospective fmombers of 
the profession, pictured themselves. Questions suggested for 
exploration and major consideration wcre^includcdjin the next 
unit. 

2. What is tho typical scquoiicc and pattern of meaningful 
learning? (a) How may tho teacher provide for individual 
capacities of pupils? (b) How may the teacher determine 
readiness to learn a particular ability or concept? (o) How aro 
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children motivated to loam? 1) IIow may tho toaclior assist 
pupils to establish realistic goals? 2) Wliat are the effects of 
rewards and punishments? 3) Ilow is knowledge of progress 
assured? (d) How may tlio teacher organizo learning exi)or- 
ionccs which possess meaning and Htrucluro for the pupils? 
(o) Wluit arc offectivo practice promhiros? (f) lIow may tho 
teacher socuro transfer? 

Tho common Hcquonco in human learning involves n gradual 
transition from imnialurc reactions to mature melliods of 
responding niid learning. During this period of dovelopmcnfc, 
tho atudontj through active oxperionco involving (exploration, 
discovory, and vorilication, acquires meanings and generaliza¬ 
tions which lead to competence. A review of procjodurcs fol¬ 
lowed in teaching Topic II, **\Yhnt is tho Typical Tattorn and 
Sequence of Meaningful Learning?” iilustratcs "llio dovolop- 
mcntal sequence of learning.’’® 

Tho major purpose of Uiis topic wiva to develop tho coni- 
potonce necessary for tlio prospective teacher to organizo learning 
experiences in llio classroom according to psyclu)I(>gi(;al ))riuciplcs 
of learning. 

Stop l.“~To acliiovc tho aI)ove purposo, a ^'ariety of concroto 
oxporionces was provided. The teaching i)roc(.!SK was presontod 
in a variety of eottings with emphasis on tho situation. A class¬ 
room visit was made in winch the student observed a learning 
situation. A film was prosonlod iind discussed wlueli illustrated 
typical classroom activities. »SLudcnl8 read general and special 
methods boohs. Lectures wore used to ilUisLraLo vaj-ioua toach- 
ing procedures, ('lass discuswonH were Jiold centering on teach¬ 
ing practices in specific .Hubject-matlcr nreas. llesource spoakens 
described teaching procedures in special fields. Iji small group 
meetings, students discussed procedures witli which thoy wero 
now familiar. Thus, tho situations in wliicli the coiKjepts wero 
oxporioncod wero simple, numerous, and varied so that tho con¬ 
cepts roinainod Iho common olomonls. In tlio leeturoH and tlio 
group meetings the concopte acquired increasingly aljstract 
moaning as opportunity was provided to difforontiato out tho 
common element. It was not considered Buniciont to have tho 


* Luolcn B. Kinnoy. "Tho Operational Plan in tho Clftsaroom.” School 
and Society. 28:146-140, Soptembor, 1048. 
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Goacopta oxplaiaed ia words. . When this accura, too often the 
result is a verbalism rather than a usable concept. 

Step 2.—The concepts which had been acquired as a result 
of the numerous, varied experiences and had become increasingly 
abstract through differentiation wero then manipulated on an 
abstract or symbolic level and relationships ■were explored. 
Opportunity to manipulate the acquired concepts was provided 
in class discussion. The lectures at this point wore designed to 
help the students explore relationships by providing the necessary 
clues for the development of the group project. 

The purpose of the group project was to provide a focus for 
the integration of concepts and understandings relative to how 
the pupil learns and how the teachor organizes learning exper¬ 
iences to facilitate tho pupil’s learning. In developing the 
learning unit, the students manipulated concepts and related 
them to a meaningful pattern. It was considered important that 
the pattern of concepts or generalizations should represent the 
students’ own generalizations, discovered by thorn. Tho 
instructor planned the situation and provided clues; but the 
exploration, discovciy, and verification represented tho learning 
process of the student. 

To illustrate tho above further, the concept of tho ‘whole 
child’ and the generalization, ^learning is purposeful,' 
to be memorized but are to bo discovered in a variety of situa¬ 
tions. The vocabulary of educational psychology must depend 
for adequacy and richness of meaning on tho significance and 
variety of experiences that havo contributed to the meaning. 
Competences to bo developed through odvicational psychology 
are not to be memorized os verbalisms, but are to be developed 
as part of tho individual student’s behavior in meeting problem 
situations. 

The necessity for concrete and numerous experiences is clear. 
It should bo recognized, however, that the more accumulation of 
oxporionces is of litilo value until they are organized. At the 
symbolic lovol tlio student is able to manipulate his concepts, 
classifying them by using one word or symbol to represent many 
items wlbli a common characteristic, and relating thorn to other 
concepts and behaviors so as to form a part of a total pattern. 
Students, in developing tho loavning unit, related tho procedures 
of teaching which they had seen, heard of, and road about, with 
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tho planning of cxpcrioiicoa for a particular classroom situation. 
The sludonla thus carriccl ovor thoir understanding from old to 
new processes, and saw tho place of the new in tho old pattern. 
Step 2 has for its purpose, then, the transfer of tlio students’ 
attention from the situalionH in which ihn (',on(i(‘pt or process 
was ))oing studied, to tho concept or proce-ss ilst'lf, in order that 
it may hes manipulated and utulevsUKul in the eontext of tho 
system of eiiucivlionai ijraeliee whore it bidongs. It then becomes 
a generalized and symbolized idea with which to iiitiU’prot and 
control now Hiliiatioim. 

Stop 3.—I/Oarning is not meaningful or useful unlc.s8 tlio 
student can utilize in new situalioiiB what has l}ccn learned 
previously. The nonc6i)la, processes, and prlncipl(*s learned 
must bo available in future leaching situations, tho character¬ 
istics of which cannot be anticipated with oxa(;lnoss. Tho final 
step in tho learning proco.*w, Ihoroforo, must bo to identify if 
possible tho utilization of tho concept in new situations—to 
identify the characteristics of those situations in which it is 
appropriate. 

In general wo may think of IhisHlage us one <Iuring which tho 
newly dofincd process or concept is inlogratod with tlio profes¬ 
sional work of tho student. Txift to itself this integration may 
or may not take place. 'Transfer of training' may occur by 
accident, hut it is not part of good tciichlng to liiavo the final 
result to chance. 

To ensure transfer and to develop planning competence, tho 
group pi'ojcct involved the organizing of learning (sxpoi’iencos 
suitahlo for a hypothetical, but typical, (das.srooin situation. 
The development of tho learning unit j'cqiiirod that lh(! students 
participate in a discussion group resembling a toaclun's' curri¬ 
culum-planning committee. Tho integration of concepts and 
generalizations, acquired previously, as do.scrihod in Stops 1 
and 2, was accomplished in tiro final preparation of tlui written 
learning unit. Tlum, in Step 3, gcnei'aliz<id and organized 
procedures wore carried back to significant prohloms. 

Tho sequence of tho learning proceas hogins and ends in life 
Bituations. In between is a stage of abstraction, organization, 
and gcaovalization. Hut, throughout,, cKccUvo lo.avi\ing at tho 
college level, as olsowherc, depends on tbo availability of many 
resources beyond the textbook and tho lecture room—classrooms 
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for observing teachers in action, demonstrations of effective 
teaching, group discussions, dramatizations, resource personnel, 
children available for study, and other means by which the 
teacher education institution and public school system are 
brought in close relationship. 

The teacher, while directing oxperioncos in the classroom 
according to psychological principles of learning, becomes 
concerned with (a) the wide range of developmental patterns of 
behaviors present and (b) the kind of persons the pupils are 
becoming. These problems arc dealt with in the noxt unit. 

3. What factors detormino the social climate of the classroom? 
What is the significance of these factoi-s for the teacher as an 
organizer of learning? (1) What should the teachor know 
about growth, development, and behavior? (2) What should 
the teacher know about the individual child? (3) What should 
the teacher know about the child's family? (4) What arc the 
dynamics of the peer culture? (6) What is the r6lG of the 
teacher in the democratically constructivo school? (B) What 
general principles concerning teacher behavior evolve? 

Tho purposes of this unit were: (a) to define the social dynamics 
that operate both within and without the classroom which 
influonco the course iof effoctivo learning, (b) to analyze the 
factors Uio toaohor must deal with which determine tho land of 
person tho pupil will develop into in tho course of his learning, 
and (o) to achieve tho outcomes operationally defined under the 
major objective—“Adapts psychological principles of growth 
and clovolopmont to individuals and groups." 

In addition to tho experiences provided in the procoding topics, 
each student made an observational study of a child of school 
age in tho community. Tho purpose of this study was to provide 
a focus for tho organization and integration of the student's 
understanding of child behavior and development. The student 
observed tho child’s behavior in a vm-ioty of situations. Ho 
visited the homo in an attempt to gain insight into tho emotional 
stability of tho homo, the pattern of training, and parental 
expectations. All behavior observed was recorded in the form 
of anocdoto.s that described objectively (a) physical development 
and health status, (b) relationships with parents and siblings, 
(c) relationships with ago mates, (d) school adjvistment, and 
(e) intorcsta and abilities. Then tlie student formulated a 
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norics ol hypothosna lo account for ihc particvi^ar pattorn of 
iKshavior and development which had ijccn tliacovored. These 
hypotheses were rherked af^aiiial an nrgunizi.'d framework of 
psycholonieul prineipk’S. The Hlndenl tloHcviljiHl kinds of 
information, not nvuiluldo, which ho recognized ns nocosHary 
to jnaUo a eomphdo dlagnoHin. Finally, the Htinhmt Huggosted 
a plan of aelion for lielping Uio cliild if Uni data so warranted. 
The dovolopirmntal kociiusiic-O of leiirning wuh impintnentod in 
this unit with llio study of an individual child serving similar pur- 
posps as those outlined for dovclopiiig the lenrninK unit. 

KVALtlATlNO OOTOOMEH 

The general plan of this study waa that of proh'ssionnl curri¬ 
culum dovolopmeut Ijeginniiig with definition of ol)jo(!tivo8 and 
concluding witli appraisal of oulcomos. The evaluation pro¬ 
cedures incorporated thoso wdiich were found clTe<;tivo by other 
researchers^ and new methods were devised. As indicated 
previously, some of the oxpcrieiutoH in tlu^ <'ourH(^ wore planned to 
dovolop theoretical uitdorstanding of a elaKsroom problem; 
some to develop al}ility of llio student to plan what ho wo\dd do 
in this caso; aixd somo to develop al)ilily to <lemonHtrut(5 cITectivo 
behavior in mooting the situation. Therefore, coinpetouco of 
tho Btudonts waa appraised at three lovola: tlicoretieal, planning, 
and performance. Three papor-and-pcncil testa wore (unployod 
to dotormiiio compoteneo at tho thcoroUenl lov(^!; Ihrts' evaluation 
forms wore constructed to appraise comijotenco at tluj planning 
level; two forma wore constructed to aummarixe performance 
behavior. A solf-ovaluation form and a student-opinion C[U0S- 
tionnairo complete tho ton major inslrnmenls om])loycd in the 
winter quarter. To dotorminc change in behavior from begin¬ 
ning to end of each quarter, the results of a rrincii)lo and Judg¬ 
ment Tost, an evaluation of first and last classroom observation 
report, and an analysis of obBCvvor comments and deseviplion of 
studoiifc behavior wore employed. 

Specific tochniquoB utilized to dotermino tho extent to which 
cxpcrionccB in this courso and not oilier couvrch liad, for the 
major part, contributed to tho dovolopmont of tho ctimpoLonco.s 

• M. E. Troyor and 0. B.. Paco. £iPa2imi(oa in Tcnchcr Eclucalion, 
WaBhington: American Council oa Tcnchcr Educnlion. lOdd. 
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wore'. (1) Btaff meetings were conducted to define and delimit 
the objectives to be achieved in this course and other courses 
in the professional curriculum; (2) conferences were held with 
individual students from beginning to end of each quarter and 
data collected; (3) trained observers mot with the students once 
per week and collected data from beginning to end of each 
quarter; (4) data were collected for two consecutive quarters 
with two groups of students, (5) tests and evaluation io^ems wore 
administered at beginning and end of each quarter. A brief 
description of instruments, representative data on which con¬ 
clusions were based, and comparisons of data for both quarters 
follow. 

Papor-and-Pencil Test Results.—Principles and Judgment 
Test was constructed and administered on the second and the last 
day of the quarter. The purpose of this test was to appraise 
student competence at a theoretical level with respect to attain¬ 
ment of two major objcctivos: "Adapts psychological principles 
of learning to individuals and groups/' and "Adapts psychologi¬ 
cal principles of measui-eraenl and evaluation to individuals and 
groups.” Also, the results were analyzed to ascertain change 
from beginning to end of quai'tcr. 

As indicated in Table 1, the mean score for the first administra¬ 
tion was 38.31 with a standard deviation of 5.44 units and a 
range in score from 25 to 62. The mean score for the second 
administration was 47.31 with a standard deviation of 5.92 units 
and a range in score from 27 to 59. On the last administration, 
three scores wore below the mean score of tiio first administration; 
in terms of standard deviation, tlio increaso was slightly less 
than two. The critical ratio of the incronse was found to bo 
9.48, which indicates iJiat the difference was not due to chance. 

The Case of Mickey Murphy,’’ a standardized instrument, was 
administered at the end of tlio quarter. The purpose of this 
test was to appraise corapetonco at a theoretical level with 
respect to the other two major objectives: "Adapts psychological 
principles of growth and dovolopmciifc to individuals and groups” 
and "Adapts psychological principles of counseling and guidance 
to individuals and groups.” The data are summarized in 
Table 2. 

Wavron R. Bnller. The Case of Mickep Murphy. Lincoln: University 
of Nebraska, 1943. 
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The moan Bcoro for each of six objcctivc-typo parts of tho 
test and tlic moan of Uie total score was computed for students 
with Leaching experience and sludcnls with no Veneiiing exper¬ 
ience. Tho means wero converted into j)crcentiie norms ostab- 


Ta-ULk 1,— Bcoheh on Judgmknt and PiUiS'cn'MiH Test, Fiiist 
AND SeOONI) ArJMINIHTllATION, 'WlNTlIK QUAUTEU 


First Administration 

Second Administration 

Score 

Frc^qucncy 

Scoro 

Frequency 




' 3 


1 

54-50 

fl 

5T-53 

1 

51-53 

11 

48-50 

1 

‘18-.50 

23 

45-47 

n 

45-17 

JO 

42-41 

17 

.12-4 4 

7 

30-41 

12 

39-11 

9 

30-38 

10 

30-38 

1 

33-35 

in 

33-35 

1 

30-32 

7 

30-32 

0 

27-29 

2 

27-29 

1 

24-20 

2 



Number 

73 


72 

Mean scoro 

38.31 


47.31 

Standard dev. 

5.44 


5.92 

(T of moan 

0.G4 


0.70 

DilT. of means 



4-9.00 

tr of cliffcronco 



0.95 

Critical ratio 



9.48 

Keliability cocfRc.icnt 



0.74 


lisiied by Bailor. Tho range in porcentllo rank of mean score 
for sixty students with no Icanhing cxi)t!n(mco was from 02 to 
01; tho rango in raw score was from 115 to 201. Tho runRO of 
porcontilo rank for twelve Bliidents with toaching ox})(5rionco 
was from 43 to G3; tho range of raw score was from 131 to 213. 
Tho dilToronco in total mean score between tlioso with oxporionco 
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and those with no exporionce was 2.83 units. A critical ratio 
of this difference was found to be 0.35 indicating that the differ¬ 
ence was not significant. CHie mean score of the students with 
no teaching experience was higher by 4.03 units, winter than 
autumn. A critical ratio of 1.29 indicates that this difforouce is 
not significant, P. being 0.20. 


Table 2.—Mean Scores for Sixty Stxjbentb with No Teach¬ 
ing Experience and Twelve Students with Teachinq 
Experience on Mickey Murphy^ Winter Quarter 


No Teaching Experience’' 


Test 

Part 

Moan 

Score 

Com¬ 

parable 

Percentile 

Rank 

Stand¬ 

ard 

Devia¬ 

tion 

Mean 

Score 

Com¬ 

parable 

Percentile 

Rank 

Stand¬ 

ard 

Devia¬ 

tion 

II 



3.12 

18.67 

59 

3.62 

III 



0.98 

8.17 

66 

0.90 

V 

61.26 

91 

7.20 

50.76 

63 

11,74 

71 

26.46 

68 

4.06 

WMHII 

65 

4.00 

IX 

47.75 

77 

6.61 


50 

9.00 

X 

22.55 

62 

5.38 


43 

6.06 

Total 

m.83 


18.63 



26.86 


Experienced Teachers 


* The porccntilc norms dcGucd by Bailer arc for itndorgraduate students 
with no teaching cxporicneo. In this study, thirty-nine students were 
undergraduates, 


The data obtained through the Principles and Judgment Test 
and Mickey Murphy indicated that the students attained a 
relatively high degree of compotonco at the theoretical level with 
respect to tho four major objectives definod for the course. The 
change from beginning to end of quarter was significant. Marked 
differences wore found among individuals. 

Planning Compotonco.—Behavior at tho planning lovol was 
observed in written classroom observation reports, in written 
observational caso studios, and in written group projects. Eleven 
learning units were developed in small group meetings. Tho 
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purpoRo of Iho learning unit waa to develop planning compotonce 
related to two major objcclivcn: “Adapts pRychological prin¬ 
ciples of learning to individualH and groups" and "Adapts 


TauivF, 3.'—Uatino op Ki.kvkn Whw'Tbn (inopp PnojEci’s, 
WlNTKU QPAUTEU 


Criteria for Haling 

Frornmno; 
nf Hating 

1 Mean 
Uat^ 

4 

3 


L ing 

1) Plans experiences which utiHxo i)roRenL 
interest to focus attention on 8ul)jcct 
matter. 

8 

3 

0 ( 

) 3.73 

2) Plana cxporionces which take into account 
factors of roadincKH. 

8 

2 

1 ( 

) 3.04 

3) Pinna experiences which meet Uie needs of 
hotcrogenoous ahililies and iiilcrcatH. 

0 

^5 

0 1 

3 3.55 

4) Plana a variety of experioncoB to motivate 
a particular learning. 

7 

3 

1 1 

) 3.56 

5) Plana p.xporloncos which ealiafy pupil 
neoda. 

0 

4 

i 1 

3 3.46 

0) Plana oxporioncca whicli ensure transfer. 

7 

3 

0 : 

1 3.46 

7) Plana exporiencoa in which motivation is 
developed through poailivo interests. 

7 

2 

1 

1 3.30 

8 ) Plans exporiencoa whicli provide opjmr- 
tunity for succossrul participation of all 
pupils. 

4 

G 

1 

0 3.27 

9) Plana experiences in which apiiropriato 
pracLico procccliu’os are cmi)loyed. 

4 

G 

1 

0 3.27 

10) Plans experiences which provide an over¬ 
view of tho whole problem and its rolatod 
parts. 

0 

1 

4 

0 3.18 


paychological principles of mcoauromont and ovalimtion to 
individuals and groups." Tho criteria employed in rating the 
units.wore ton operational dofinitions of tho two objectives. 
Eaoh:<^£ those critovia was rated on a 4, 3, 2,1 scale. A 4 rating 
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was interpreted to indicate competenco expected of effective 
classroom teaching, a rating of 3 to indicate competence expected 
of effective student teaching, a rating of 2 to indicate com¬ 
petence necessary to Sntor student teaching, and a 1 rating to 
indicate doubtful competence for student teaching. The results 
of the rating are summarized in Table 3, 

The major purpose in developing the observational case study 
was to develop planning competenco as outlined under the other 
two major objectives: “Adapts psychological principles of 
growth and development to individuals and groups” and ‘^Adapts 
psychological principles of counseling and guidance to individuals 
and groups.” The form developed for evaluating the case study 
included ten operational doliniiions as criteria; each rated on a 
4, 3, 2, 1 scale as described for the learning unit. The results 
are summarized in Table 4. 

The data thus obtained through evaluation of the learning 
unit and the observational case study indicated that tho students 
developed a relatively high degreo of planning competence with 
respect to tlio four major objectives defined for the course. 
Group performance as exhibited in the learning unit was superior 
to individual performance as indicated in tho case studies. In 
comparing results for the two quarters, mean ratings wore 
higher for the second quarter, but not significantly so. A wide 
range in planning competence was found. 

Performance behavior.—Group meetings provided oppoi*- 
tunity for observing student behavior in mooting actual problems 
involved in organizing the learning unit. Graduate students 
and teaching assistants in the School of 35ducation observed the 
behavior of the students. Tho same criteria formulated for 
rating tho written group projects woin employed by tho observers 
in evaluating the competence of each group's behavior. Indi¬ 
vidual members of each group wore rated by tho observers on a 
4, 3, 2, 1 scale using as criteria six operational definitions of tho 
lifth major objoeLivo, “Develops professional behavior.” Each 
obaorvor recorded tho quality of individual student participation 
for each meeting in the following manner: a plus mark to indicate 
a positive contribution, a minus to indicate a delaying contribu¬ 
tion, a question mark to indicate a question being asked, and a 
zero for an off-tho-track comment. In addition, anecdotal 
information was recorded concerning individual and total group 
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Tadmj 4.—Rating op Sevknty-pive Ouseuvational Case 
Stupies, Wjntek Quahteu 


Crilorin for Rating 

Frequency 
of Killing 

Mean 

Rat- 

4 

3 

2 

1 

idg 

1 ) EvalufUcs tlio ofTcct of the home on tin* 
behavior of the child. 

41 

20 

0 

2 

3.41 

2) Collects and records information concorn- 
jng the child in objective anecdotes. 

|4o 

17 

9 

4 

3.37 

3) Demonstrate.^ understanding of liow 
growth factors influence llic behavior of a 
particular child. 

30 

22 

L4 

3 

3.21 

4) DemonstratcH understanding of liow 
Bcliool adjustmouL innuenecs hehavior of 
the child. 

31 

24 

10 

: f) 

3.08 

6 ) VlanB practical ways of helping the child.* 

\{) 

If) 

0 

4 

3.05 

0) Domonstratos understanding of how Die 
leacbw may use guitlftnco Vdoa and aniui- 
dotul records to ovahmte the adjustment 
of tho child. 

20 

20 

10 

8 

2.92 

7) Recognizes how the teacher may help tlio 
child aehiovo satisfactory relationships 
with ago raateg. 

20 

22 

20 

7 

2.89 

8 ) Demonstrates undorslanding of inlorcsts 
and abilities which influence tlio behavior 
of tho child. 

23 

29 

13 

10 

2.80 

0) Chocks hypotheses against an organized 
framework of psychological principles. 

2-1 

22 

IS 

11 

2.79 

10 ) Eonns a Borica of hypotlicsos to account 
for ft particular pattern of behavior. 

23 

2C 

20 

12 

2.72 


* Tliirly-four were not rated on tliia crilorion bocftUBO tlioir (lain, did not 
Warrant a plan of remedial action. 
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behavior. During the autumn quarter ten observers participated 
in the study; in the wintGr quarter thei« were six. 

The range of mean ratings assigned by ten group observers 
for the ton criteria listed in Table 3 was from 2.80 to 3.70, autumn 
quarter; in the winter quarter from 2,83 to 3.67. For the 
autumn quarter the number of students rated 4, 3, 2, 1 was 39, 
37, 19 and 8 rospoctivoly; in tho winter quarter, 19, 19, 7, and 0, 
respectively. 

A summary of the participation record and a report of descrip¬ 
tive anecdotes in chronological order for two students, autumn 
quarter, illustrates tho data on which individual ratings were 
based: Student A, assigned a 4 rating; this student was the group 
recorder once; the group chairman, three times. 

Participation record summarized: 

Prom nine to twonty-threo positive contributions per meeting, 

From two to five questions asked per meeting, 

No oJT-trnck comments. 

No delaying comments. 

Descriptive statements: 

Always conscious of what group is doing. Good at directing; volun¬ 
teered nn assignment at end of meeting. (First meeting.) 

Read report to group; a positive contribution. 

Showed oxcchentlcaderBWp: 

"Let's do something more eonstructivo." 

"Wo'ro to consider the psychology; how wo’ro going to put tho 
material across." 

Suggested assignmont of definite toslm, oxtra meetings. 

Wont after film catalog. 

Direct, practical, good organizer. 

Has taken over chairmanship, is completely conscious of whole group 
situation, of each individual. 

Organizes, allocates responsibilities, checks for performance. 

Student D, assigned a 1 rating; this student served as recorder 
onco; never a.s chairman. 

Participation record summarized: 

From three to eight positive conlriliutiona per meeting. 
l<'roin ono to tliroo questions per meeting. 

From ono to four off-track comments per meeting. 

From one to five delaying contributions por meeting. 

Absont from one mesoting; positive contributions decreased from 
beginning to end of quarter. 
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Descriptive commcrils: 

Tak^ project lightly. 

AmtwcU over ailuatioii. 

Dooati’t lifllntt to ollicm. 

Makes very tew positive cnntribuliona 

Appear*! uniiiterwiled. 

The first purl of f»iic obKcrvor'H miinmnry of group progrosa 
illuHlr/Ucs disjigo froui loginning looiiri of /iu«rior uml i/ulicates 
quality of porfi>riiiance: 

"At tho first meeting three or four Htudenlrt did most of the 
talking. The otliors liHteiiod or hosituiUly Hulrinittecl quoations. 
Tho timo was spent in selling up n iourning silualioii for tho 
sludy. Tho next meeting was cliarnclerizcd by grealor par¬ 
ticipation by all tnemliera; they were still not diBCUKaiug learning 
but wore ompluisizing the dc.sircd learning BitimtioiiH. By tho 
third meeting, most of tho lucmbora realized tlioy luid accom- 
pVmiiod lilLlo in regard lo uiideralunding and o.vi)lftiniiig Llio 
learning process. This uiulorntandiug could be attributed to 
Humorous causes such as uiilsiUo reading, aubgrouj) dlHcuasinas, 
possibly diacusaioii with other groupS} and cia-sual (U)nv(uaation 
with each otlior. Tliia awnrunosB was n«lic(!ai)ly pi'(!a(*nL during 
tho third mootiug, along with a dolovmiuaUon, t<i do Homethiug 
about it. Tliis insight added vigor lowjird Holiitinn of tlioir 
problem. Small aul)groiip8 wore sot up for gathering information 
and organizing it around the carlior learning situation or frame¬ 
work. Tlio chairman of each gi’oup reported on Ida sootion 
of tho work, mado the ncRossary revisions Buggo-sliul by tho 
group and finally inserted lii« contribution in with tlio roinain- 
ing body of matorial making up tho Group 2, Section 2, Learning 
Ropovb.*' 

The data collected by tho obsomrs indicated that tho students 
demonstrated satisfactory compcloncc in meeting actual prob¬ 
lems. Other data obtained in mdividual confonnices and in 
rccordora’ reports submitted after each group mooting nubstan- 
tiatod this conclusion. A range of coinpotouco was found among 
tho students in mooting actual situations and in exorcising pro¬ 
fessional behaviors. 

Sfcuclont opinion and solf-ovalualion.—Conclusions j'opoiiod 
thus far have boon based upon data obtained from objoctivo-typo 
teats, rating scales, and anecdotal iniorniation. In tho ques- 
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tionnairo and self-ovaliiabion form, students expressed their 
opinions concoriiing tlio course and eatimated their own com- 
potenco. These instruments were developed and administered 
to summarizo in quantitative form (1) tlie effoctivoncss of motiva¬ 
tion, (2) tho dogi’co of student accopiajieo of the objectives, (3) 
student opinion of course experiences, and (4) student self-rating. 

Tho questionnairo consisted of two parts, tho first containing 
ftftcon questions concoTning courso activities and objectives, 
the second containing six questions relating to weaknesses and 
strengths of tho course. la Part I, all students expressed the 
opinion that tho course had been valuable in increasing their 
compotonce as toachera and in developing their understanding 
of tho r61o of the teacher os an organizer of learning experiences. 
There wore no negative responses to those items, hlinety-seven 
per cent felt that the course hod increased their understanding of 
how cliildren loam and of tho i*6Ie of tho teacher in counseling 
and guidance. Ninety-four per cent felt that the course had 
inado other educational experiences more meaningful. Ninety- 
two por cent indicated that tho course had incroased their undor- 
standing of child growth and development. Concorning specific 
course activities—lectures, classroom observations, learning 
unit, case study, and class discussions—six. to eighteen per cent 
expressed tlie opinion that ihoso liad not contributod to achieving 
tho purpose intondod. Ninety-six por cent indicated that tho 
course would not have been more valuable as a 'straight' lecture 
course. Understanding of psychological theory applied to tho 
classroom was increased for ninety-four per cont. For twenty 
and fifteen por cont, respectively, the course did not open any 
new fields of interest nor was tho course organization meaningful. 

In Part II of tho questionnaire, students listed all major 
activities as strengths of the course; all major activities were also 
listed at least once as weaknesses of the course. For improving 
tho course, students listed more time for developing the various 
activities and also suggested increasing tho unit credit from four 
to eight quavtor-liouvs. Suggestions were mado for improving 
all aspects of tho course including selection of toxt materials. 
Tho data in Part II supported that obtained in Part I; the 
majority accoptod tho activities as valuable in nchioving the 
objectives; for a minority one or more activities wore not con¬ 
sidered of value. 
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Table 5.—^STODENT Ratjno or Own CoMi’ETfiNCE, Winter 

Quaktku 


F 

(> 

(Irilci'hi for llaliiiK 

rccpiency 
f Hating 

Moan 

Hat- 

•1 

3 

2 

1 

ing 

1) EvaUuvles llio ofTcct of lUo. Ivomo on l»o- 
Imvior of llio child. 3' 

7 23 

(1 

0 

3.47 

2) UndorHlamlfi use of giiidaiico filort niul 
anocdnlal rccorclK to ovhIuuIc ndjuHtnionl 
of cliild. 3: 

3 25 

8 

0 

3.38 

3) VlaiiH Icuriiiiig cxiiorionccH which utilizo 
proBonl iiUorcHl to focus attoiiUoii on hu))- 
jeet mutter. 3 

■1 25 

(> 

2 


4) C'OlUicts nnd records information concern¬ 
ing pupil l)ohttvi(jr in ohicclivo imc(Mlol<?s. 3 

1 27 

H 

0 

3.36 

6) UiidcrBtujida how growth factors influence 
tho haliavior of a particular child. 3 

0 25 

10 

H 

3.27 

6) riuna loaming cxporioiiccH in wliich moli- 
valion is developed tlwouj^h iiositivo in¬ 
terest. 2 

.2 30^ 

Id 


3.12 

7) Plane learning oxporiencoa which provide 
opportunity for eucceseful participation 
of all pupils. 2 

15 25 

M 

2 

3.11 

8) Plans practical ways for helping the child. 2 

1131 

12 

1 

3.11 

9) ■(Jndci'fltands tho implicalions of social 
class training for tlio icnclior. 2 

!() 25 

in 

1 

3.09 

10) Plana a variety of oxporienccs to motivate 
a particular learning. 2 

il20 

M 

2 

3.05 

11) Uiidoifltauds conditions necessary for 
maintaining group inoralo in tho olaas- 
room. 1 

.7 3'! 

13 

2 

3.00 

12) Plans oxporioncos which take into account 
factors of readiness. 1 

[(135 

15 

1 

2.08 

13) Plans oxporioncos which provide an ovor- 
viow of tho whole problem and its rolalod 
parts. 5 

i3 23 

113 

G 

2.07 
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Table 6. — {Continued) 


Criteria for Rating 

Frequency 
of Rating 

Mean 

Rat- 


4 

3 

2 

1 

ing 

14) Forms a series of hypotheses to account 
for a particular pattern of behavior. 

16 

35 

12 

3 

2.97 

16) Recognizes how the teacher may help the 
child achieve .satisfactory relationships 
with ago mates. 1 

17 

31 

|13 

5 

2.91 

16) Plans learning experionccs which satisfy 
pupil needs, 

15 

30 


1 

2.8S 

17) ‘Understands how tho teacher may use 
standardized test results to ovaluato the 
status of an individual child. 

18 

26 

m 

1 

3* 

2.88 

18) Participates in defining instructional ob¬ 
jectives and in curriculum planning. 

18 

26 

17 

6 

2,84 

19) Plans experiences which ensure transfer. 

14 

31 

16 

5 

2.82 

20) Plans experiences which meet tho needs of 
heterogeneous abilities and interests. 


35 

IS 

4 

2.76 


On a solC-ovaluation form, atudcnts rated themsolvGs on a 
4, 3, 2, 1 scale using as criteria for rating twenty operational 
dofinitions of the four major objectives. Nino of these criteria 
wore identical to those employed in evaluating the learning 
unit; seven were identical to thoso used in rating tho observa¬ 
tional case studio.s. The results of this rating are summarized 
in Table 5. 

Students in appraising own competence demonstrated a 
range both with respect to a particular criterion and different 
oritoria. Tho general pattern was similar to that obtained in 
other ovaluativo instruments. On the criteria identical to 
thoso for tho group learning unit, moan ratings were lower in 
tiro 6olf-ovahintion than for tho group ratings. On criteria 
identical to thoao Cor tho case study, tho range of mean ratings 
on tho self-appraisal was from 2.88 to 3.47; the moan raiing-s 
assigned to the written studios ranged from 2.72 to 3.41. 
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8UMMAHY 

A couraa in ctlucntioiml pBycIioIugy for toaclKini wan organizod 
with objeclivca (ioliinid m UjucliinK bduiviorH u'hitrli hohaviota 
woro drawn from "I'actonn in Toacliini; CoiniKHoiico." (!ourHe 
oxiKiricnccH worn (irj^aniw'd to nrliinvii the (dijcctivos, and 
tsvftlualiun l)ro('(‘<lu»‘i‘n wore doviHcil to dnlcriniiio Llio I'xUiiit to 
wliinh tlic lonclit'r ('(iiniMiU'iipm worn d(iV('loi)(!il. Tlio data 
collor.Uid and uimiyznd for two conw'tailivii qnarun’rt witli two 
groups of Htiulmda iudirato that: 

1) TliQ ol)ic(’,tivo« iw doliund and dniimiUid for (ho luat qiiartor 
wore psychologically valid. 

2) Tho courso cjiiiorioncoB ns organiznil and itroBcntod woro 
ofTcclivo in dcvolojiitig iuaching uompoloncos as didliUH] in this 
study. 

3) Tlio ovor-nll strategy was oIToclivn in iichioving tlio ohjoc- 
tives. 

4) At tlirw lovolH'-thoorolicul, planning, and pnrformanoo— 
tho majority of sUidonls oxhihitvd a Idgh lovoi of wnupoUmco. 
A small minority did not demoiiHlraln Krowili or KUtiKfmitory 
compotonoo at any level and were mcominemhal os dmiliLfu! 
candidatfis for tho toaeliing profession. Bccjuifio of the paucity 
of data roltttivo to pi'c-sorvice standards, tho conclu.'iioiiH in 
terms of 'higli' and ^insaiisfactory’ wore ncfowiiirily lontativo, 
It is rocominondod that tho students bo followed in tlioir studimi- 
toftcliing and later toacliing positions. Tho (inul critorion upon 
which the oiToctivonciHK of this or any profossional coiu'rto can ho 
dotorminod must bo tlio quality of pupil growth dovelopod in 
tho toftohor’a classroom. 



A STUDY OP TEACHING POTENTIALITIES* 

J. DAVID O’DEA 

School of Education, Orcgo® State College, CorvalUs 

This study is in the general field of the iHGasuremont of a set of 
characterlstiGsobjectiYGlyrcgardedassymptomatio of an aptitude 
for the teaching profession. 

First will be presented the importance of this and similar 
Btudies. Secondly, a brief treatment of the early testing move^ 
ment in the selection of teacher candidates will be given. Finally, 
a feasible procedure will be offered which will assist in the selec¬ 
tion of teacher candidates. 

IMPOBTANCE OP STUDY 

The research of Dr, Ray C. Maul® in the field of supply and 
demand of teachers has pointed to a need for additional studies. 
In reference to his educational research, Dr. Maul writes, “It is 
designed to help the public gain a fuller understanding of a 
problem in which the public has a vital stake, namely the improve¬ 
ment of schools in which the children of today must be prepared to 
meet the unpredictable problems of tomorrow.’’ 

To relievo this vexing problem the leaching profession must 
labor in the partnership with the farmers, ministers, merchants, 
and others engaged in helping children to become better adults. 
Obviously, the people needed to meet the present demand should 
possess qualities or traits of competent teachers. 

RELATED STUDIES 

The professional schools for training teachers have limited 
means for ascertaining in advance whether a candidate has or can 
acquire those qualities possessed by successful teachers. The 
measurement of teaching efficiency has engaged the attention of 
rosoarcli workers for several years. Moriam,® in 1906, is 
credited as being the first who attempted to use objective meas¬ 
ures of qualities related to teaching efficiency. This first attempt 
in removing the moasurcraent of touching ofliciency and aptitude 

* For thoiv consLnictivc criticism, appreciation is cxtondccl to Ralph 
EvauB, Head ot the Depcirtmonl of Education, Freano Slate Collego and to 
W. M. Ehrenm, Director of Guidance, Wichita University. 
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from Vhc field of opinion lo iUftt of objective measurement was 
followed by numerous attemptw. Uccauscof one or iimny reasons 
thcBC altenipts Iind only limited Nuecess. 

Uuediger and ^Slraycr" in lOlO cniiHlructeil a device to meas¬ 
ure charaelcriHlIcH of icncherH ns related lo t‘irn:ienry in learhlug. 
This attempt did not j>rove liiRlily siiefe^^ful. In 1U12, lOIliot 
and lloyce*'-* dtiviKcd wore cjmls for the ineasuromeul of 
tcarliliiR eflieieney. The score ejinls for ralinR learlicr.s wore 
markc<l liy the teacher's RuperviHtjrs- 'i'lufM* milhors (MMieludcd 
that the reports were Uh» hiKli» due to u ludo (?fT('el of liio mtings 
on the score cards. 

TA-UI.E I.—iVVKluaK COUUKI.ATION OP Supr.iiviHoiw' Hankings 
AN u TUK Listed Mearuuki) ChiAUACTEniSTicrt 


Quality or Trail r 

Scliolarwhip. -i-.OOO 

lulclligonco. .. 4-.5C0 

Profowiionul Study in Service. .-1- .393 

Salary. ..-I*. 352 

Total Tcndiing Kx[iericnce. .. H-.172 

Scores on a Profcwiioiud TchI . *h. 147 


Knight* made an olijccUve study on genenil toaeddng ability. 
His method was lo obtain ratings of Icuchors liy Imlh suporviHors 
and the toachera’ asHuciatea in teaching upoTv general jivofesHional 
ability. Kach judge ranked the leaelioiH wliom lie knew in mder 
of merit. Thcflo rankings wore then Irnnsmuled into nmnericid 
units representing the composite jmlgment of each group of 
judges. Against tins criterion he eorrolated lljc. ineuKiiroinonts 
made upon a number of trails which could Im measured objec¬ 
tively. The average correlations found for high sidioal Icaclicrs 
arc shown in 'J'ahlc 1. 

Knight applied tho same mcUiod used for higli Kcliool Lea<'.lioi'8 
to tho study of Llic elementary Hchool leuclims. 'I'wo of Ids 
results should he noted: lirst, n correlation of -I-■•''>11 be.tw(?(‘n 
teiiehing oineiency of elementary Hchool leueiufrs and a profes¬ 
sional test; and second, a correlation of H-.lOK hetweim teaching 
efficiency and scoi'cs on an mtclligcnco test.* Knight con¬ 
cluded that a professional tost is higlily predictive of teaching 
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efRciency for olementary school teachers, hut he suggests that an 
intolligence test may be more desirable for prediction on the 
secondary level.* 

In 1923, Somers^® obtained ratings of teachera in their first 
year of experionco. He used a score card and correlated against 
this criterion scores in intelligence tests, school marks, participa¬ 
tion in extra-curricular activities and personality estimates. The 
most significant correlation co-efficients are shov/n in Table II. 

Table II.— ConniiiLATiON opTeaciibrb’ Rating in Thbtr Tiest 
Year Experience and Listed Cuiteria 


Factors Used r 

Normal School Success. 4-. 73 

Two Years' Marks in School. + .71 

Teaching in Training School. + .70 

Personality Estimates... +. 62 

First Semester Normal School Work. -h . 60 

Intelligence Tests... d- • 43 

Extracurricular Activities. + .41 

Class " Cuts” in Normal Schools. +. 53 


A study by Whitney^’ followed a similar technique used by 
Somers. The correlations between the criteria and leaohing suc¬ 
cess as monsured by supervisors arc as follows: 

Table III.— Coriielation orTBAcnEns’ Rating in Their First 
Year Experience and the Listed Criteria 


Factors Used r 

Intelligence. 4- ■ 025 

Secondary School Marks. 4- -091 

Marks in Academic Subjects in Normal School. +. 073 

Marks in Professional Subjects in Normal School. 4- • 143 

Practice Teaching in Normal School... 4“ -238 

Physique. 4--124 


Knight, lluch, Telford, and Bathurst’ have published a set of 
professional tests for elementary school teachers. These aptitude 

* Dr. C. W. Boardman haa written an excellent condensation of Knight’s 
study. His research, reference,* was particularly helpful to this study. 
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wurc the first fur which a measure uf vali4ily was ol)tivmc(l. 
The authors oljlainctt a porrelnlioii eo-enifirnt of -h.378 using the 
UMslBCorc-s and the, tuoril of mnkingof the? leachcralty suiicrvisora. 

Corrna|)nnrlinK to Knlghl'a aUiily in the (icorgc! Wtushiiigtoii 
Dnivernty SerirH, pre-imnsi by 1'. A. Mofw, T. lluiil, and I'. C. 
Wnllneo in Iho coiipnrutinn with vuriima (nlucaLors.’® 

The progrcHH in (tehi of teacher ujititatle IcsIh is illiiHtratcd 
by Ringhain.® 

"'i'lie profe.‘esli)nal aehoola for Iruiniitg teachers liuve as yot 
found no miro means of asccriaining in ailvaiiee wliotlior a 
candidate. ha« or can aequirtt l!»e trails dcHcvii^cd in tho 
foregoing parngrapliH, although marked defects ainl short¬ 
comings arc nsunlly roc(>gnir.ablo during an interview with 
an applicant for adniisKion. Ifia intj?lle(!tual grasp and 
mental alcrlne.sa can lio fairly well e.sliinaled by roferoneca to 
his previous sduud recor<I and his iierforinanee in tests of 
seholuslic aptitude, vocahulury, JvngliHli nsiige, matlic- 
malies, and oilier Acadnuio Hubjents, hupplerncnled when 
necessary by specially devi.scil lestn of intelligence such an the 
Coxo-Orleans Prognosis M ost of Tcacliing Ability." 

Tho Coxo-Orlcsns Test is a device to measure th(» ability to 
learn the subject matter taught in school, 'riio live of the 
teat moofluro the candidate's general information, knowledge of 
teaching methods and praetinCB as acquired from his tibsevvation 
a.s a student, ability to learii.tlic type of mattnial jtichnhsl in pro- 
fesHional reading matter, and aiulily to study and work out 
educational jivoblomH. 

The co-oHlcicntfi of corrchvtion between te.sl scioro.s and iicliicve- 
ment at the end of the (irst college year range, hcitween .08 and .84. 

It is noted that, although the alilhor.s luive domon.siruted the 
value of tins lest for predicting school acliiovomont, Die extent 
to whicli it is prognostic of actual tcacliing aliility has not been 
ascertained. 

A recent rcfcrenca pcrtaiuing to the mciisuroinoat and predic¬ 
tion of tcacliing offioioncy is a monograpli by Ihirr* and oUicrn, 
Tho monograph, "The McaHuremci^t anti I'redipAion of 'I'eitidnng 
EfTicieiicy; A Summary of InvcHtigations," supplies data on tho 
validity and reliability of some 72 testa, rating ecalca and iiivcn- 
torics frequently used in this area. 



A Study of Teaching Polentialilies 


477 


SELECTION OF THE MEASURED CHARACTERISTICS 

A test to measure the characteristics listed in Table IV was 
constructed under the direction of Dr. H. E. Schrammel, Director 
of the Bureau of Measurements, Kansas State Teachers Col¬ 
lege, Emporia. 

Studies indicate that personality and intelligence are highly 
Bignidcant factors for measuring teaching apUtvidcs. Knight 
found these factors significant to teaching efficiency in high school. 
These two basic traits were not measured in this study. 

Table IV lists the set of characteristics that were selected for 
measurements. 


Table IV.— Characteristics Measured in This Study 



Test 

Form 

No. of 
Questions 

1 . 

Interest 

Multiple Besponse 

15 

2 . 

General Knowledge 

<1 (( 

45 

3. 

(a) Procedures in Teaching 

H II 

20 


(b) Teaching Information & 
Judgment 

True—False 

67 

4. 

Prof. Beading Comp. 

It _ 11 

25 


Total 


172 


TRYOUT OF TEST 

The control group in this study consisted of teachers. The 
teachers cooperating in the study wore probably a select group of 
professionally minded teachers who would tend to rank above the 
average of the school teaching population. They were ele¬ 
mentary, high school, and college teachers all of whom were mem- 
hoxs of the faculty at the Kansas State Teachers College, Emporia. 

The second group consisted of college students. This group 
was broken down into various categories as indicated in Table V. 

In summary, nearly three hundred tests were given. The 
time required to take the lost averaged about fifty minutes. 

SUMMARY OF STATISTICAL DATA 

The majority of tho statistical measures were computed from 
the test results obtained from the administration of the test at 
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the Kansas Stale Teachers College. T)ie basic data are shown in 
Table V. Additional data compuled from the basic data arc 
lialetl in Tabic VI. 


Tadlb Y.-“Compaiuhon of Yauiouh SfATisTicAL Mkahuubs 



Control 

Ail of llio 
ICsperi- 
mciUal 
Clrcjiip 

Nmi- 
Icaeliing 
C! rouj) 

Experi¬ 
mental 
Croup, 
going 
to Teach 

Median 

147.1 

120.0 

120.3 

127.3 

Mean 

UG.9 

125.0 

110 

127.2 

.Standard Deviation 

5.9 

13.7 

13.5 

12.2 

Sigma Moan 

1.07 

1.00 

1.82 

1.05 

Number of Oases 

30 

189 

57 

132 


lU-ad Tahio thus; The mndinn for the control gfo»>p was M7.1; for Iho 
oiiliro group, 120.0. 


Tadlb VT.—Compaiuson op 1‘udtiiku Statiwticial Mic.^amiES 

Number of 


All of tho 
Experimental 

DilTcr- 

cncc 

Sigma 

Diffor- 

cnco 

DiiToronce 
Sigma DifTcnMieo 
(Critical Hatiu) 

Chanecs in 
100 of True 
1 liffcronco 

Group 

Non-teaching 

21.9 

1.4G 

15.0 

100 

Group 

Experimental 
Group Going 

27.G 

2.10 

13.1 

100 

To Teach 

19.7 

1.50 

13.1 

100 


Road Table lluis: Tlie difTcrcncD l)t!twoniJ lliu conlrol group Inio moan and 
all lliQ cxpcrimoiilal gro\ip Iruo menu wns 21.0. 


Comparison of the mean seoves hIiowh tlu\.t the eontvol group 
made a higher score than did either of tbo exi)m‘imonlnl diviHioiiH. 
The mean score for the control group was l-Ki.O and that of the 
total experimental group, 125.0. 

Tho data listed in Table VI deal with the reliability of the dif¬ 
ference between tlio mean scores of the control group and tho 
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expenmontAl groups. It will be noted that because those dif¬ 
ferences are large and the sigma differences are small, the data 
yield a statistically significant ratio. In other words, there 
are 100 chances in 100 that the differences possess statistical 
significance. 

By correlating the odd and oven scores of the test a reliability 
co-efiicicnt of .77 was obtained, The P. E. was ± .009. By cor¬ 
relating the combined scores of Parts I and II with Parts Ill and 
IV, Tabic IV, a reliability co-efRcieiiL of .88 was obtained. The 
P. E. was ±.007. 


SUMMARY AND CONCLUSION 

This study attempted to isolate a set of measurable character¬ 
istics indicative of teaching success. The test used to measure the 
charactcrifitica inclicatca that the control group possessed the 
measured trails to a higher degree than those of the other group. 
In general, those preparing for leaching score higher than those 
preparing for some other vocation. This finding is vitally signif¬ 
icant to the study. 

It is fuuiul that a good toaclicr need not score high in one 
singled out characteristic. However, a good teacher should pos¬ 
sess in total a high clogrco of laiowlcdgc, intellect, interest, 
professional vending comprohension, and Leaching procedures. 

Personality has long boon hold to bo a largo factor in teaching 
success. Past studios have indicated that suoli traits as self-con¬ 
trol and pationco arc essentials to teaching success. 

It is the opinion of the author that the following procedures will 
provide some indications necessary in attempting to evaluate 
those traits indicative of teaching potentialities. These factors 
are: (a) the Btudcnt’a attitudo regarding furthor education and his 
nice or dislike of pi'ovious educational experiences. This involves 
the student’s previous school success, (b) The student’s per¬ 
sonality should be investigated. This includes mental ability, 
emotional pattern, and tljc work liabits of the student, (c) 
Finally, careful con.sidcration of the measured characteristics as 
listed in Table IV is statistically significant in the selection of 
potential teacher candidates. 
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TECHNIQUE FOR EVALUATING THE ABILITY OF 
TEACHERS TO APPLY PRINCIPLES CON¬ 
CERNED WITH THE DEVELOPMENTAL 
NEEDS OF ADOLESCENT GIRLS* 

SARA ANN BROWN 
West Virginia University 

The purpose of this study was to develop a technique for evalu¬ 
ating the ability of secondary-school teachers to apply the princi¬ 
ples concerned with the developmental needs of adolescent girls. 
The first hypothesis was that poncil-and-paper tests would be 
developed which would measure the ability of teachers to recog¬ 
nize and apply principles concerned with human growth and 
development of adolescents. Two tests were developed to meas- 
uvo this ability: Test A, Recognition of Principles; and Test B, 
The Case of Jacquoline Croner, essay and short-answer forms. 
The second hypothesis was that one case study would be suffi¬ 
cient to measure this ability. 

The assumption was that it is important for all teachers to 
bo able to apply principles concerned with the developmental 
needs of children. The exporimontal group in the study was 
composed of home economics teachers at the secondary level, on 
the further assumption that instruments which wore valid and 
reliable for that group would bo equally useful for all secondary- 
school teachers. 

Test A, Recognition of Principles, was made up of sixty-two 
principles which related to the needs of adolescents in three 
major aspects of development: physiological, social, and integra¬ 
tive. A jury of four judges assisted in the selection of the princi¬ 
ples and agreed unanimously on the key for the short-anawer test. 

Test A was revised after having been administered to a pre¬ 
liminary group of thirty-five home economics teachers in. West 
Virginia to discover any lack of clarity in vocabulary and state¬ 
ment, any difncultics in administration, and to dotomiinD the 
length of time requirod to givo tho teat. 

Test 13, Tho Case of Jacqueline Croner, was designed to mcas- 

* Abstract of Doctoral Ibcsis siibrnillcil to Grnduato Faculty, Iowa Stato 
College, 19‘19. 
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urc the ability whicli U^aclicra Imve to apply princii)lcg in inter¬ 
preting (lutn concerned with Ibc devciopnienUl needs of adolcs- 
eoiits, and to select ediiciilional means for helping pupils with 
tboit i>r«bleinH. Tlu^ lesl wan a dearri}>lion of an atlolescont 
boHcrl on data from a enmulativc record of ii liigh-Hehool girl. 
A »hoi'L-a\\aNvi;r form whieU naetl re«pou«t!s fun\iHlu;d l>y i\ pro- 
liminnry group of luune. econninics trueherH wtw koI, up. These 
rcRponwH were in tliu form of Htutemeuls uinl were eviiluutcd for 
tlieir clarity and cuneiHeiicKH. The lest was adminiHlerecl to the 
eeme preliminary group as the one which r('ticLed to Tost A. 
ItcviHionH bnwid on the rcsultH from the preliminary group were 
made. The rcvificil lphL which cDiitaincd one iiundred ton items 
was administered to a jury of six judges, and from lludr rusponsea 
the key for scoring was dcterinineil. 

Tlio trial groiu) to whom llie tests were ailministererl w'ns made 
up of oighly-eigUt homo eecHioiidc.s Imudicrs in W(*sL Virginia 
who hud signified a willhigiiess to parlici]>at(^ Stw'cral factors 
were considered in sclccUtig llie.so |pneh<*rs: marital h( uIuh, recency 
of graduate study, hinglh of leaching <fxperienc(‘, and tlio feusi- 
l)ility of visits by tins writer. 

'fest li, 'I'lie Case of JacrpieUno (Ironer, essay form, was sent 
to eacli of tho participants. This was followed l»y 'IN'st li, sliort- 
aubwer form;andT'est A, UccoguiUunof l’yincij)lcH. 

Tlio rcliaijility of Test A was (letcriiiincd by (>l)taining tho cor- 
reluUon coclTicicut between acoves on split halves. A Veiiv«uniiu\ 
coclficicnt of corrcIaLion was obtained, .730r>, and corrected fur 
donblo length by tlio Hpearman-Hrown inodiliud forrntda. TIuh 
correction yielded a cocflicioiit of reliability of .818 ± -030. 
Since testmakers cite a rclatlonHhip of .UO as very higli lliis relia¬ 
bility is con.sidcrcil very saU.sfaclory. 

Tho reliability of Test Ib abort-answer form, was determined by 
tho samo method ami wlicii tlie correlation of .837‘J was corrected 
for douljlo length, it was found to ho .913 ± .018, a result which 
would iuclicafco a very <lcpendal)lo reliability. 

Two methods for ostahlisliing validity of tho in.sl.rumcnl wore 
employed. Ono was tho coiTolating of scorcH on Test A and on 
Tost B, essay form, as well as tho seoros on Tost A and Test B, 
sViort-anawor form. Tho ooclTioiontB obtained wore: 

Test A and Tost D, essay .050*1 ± .009 

Test A and Teat B, short-answor .0758 + .005 

Test B, short-answer, and Test B, essay .9303 ± .013 
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In order to have greater con&dence in the results, cooperation 
from another group oi ninety home economics teachers in West 
Virginia, who had not participated in the first group, was 
requested. The procedure except for visits and interviews was 
duplicated and the cocfRcicnts of correlation were again obtained. 

Tho reaulta for the second group \Yero: 

Test A and Test B, essay .9506 i .010 

Test A and Test B, short-answer .9557 ± .009 

Test B, short-answer and Test B, essay .9247 ± .015 

These results would seora to indicate that the high correlations 
of the first group were not due to sampling, since the differences 
in the correlations are slight. 

A second method of validation which was used, was to compute 
ooofiicicnts of correlation between the performance on the instru¬ 
ments with a criterion assumed to bo valid. In this study that 
criberion was tho scores obtained on interviews which the writer 
had with tho teacher, the principol and/or the superintendent, 
and the score on a one-day observation of the tcaoher, designated 
as an intorviow-obsorvation score. Records of these interviews 
and observations with Uio group of oighty-eight teachers wore 
kept by tho writer, and these were scored by a jury of five judges. 
When coofiiciGnts of correlation were computed between the 
scores on the tQ.sts and the interview-observation scores, the 
correlations wore: 

Teat A and intorviow-obsorvation scores . 8748 

Test B, essay form and iutcrview-ol^vvaUon seoves .9013 

Tost B, short-answer and interview-observation scores .9113 

Since Test B was designed to measure the ability of the teacher 
to diagnose problems and select remedial measures, coefficients 
of correlation to determine whether one section of the test was 
more valid than the other were computed. The correlations 
between tho diagnostic sections on the t%YO tests—Test B, essay 
and Test B, short-answer form—was .7880 ± .040. Tho cor- 
volation between the brovcs on the two remedial sections was 
.4327 ± .087. Also eompuLcd wore cocirioioiits of correlation 
between the flcoros on tho remedial section of the short-answor 
form of Teat B and the interview-observation scores; the result 
was a coefficient correlation of .7866 ± .041. 

The items on both Test A and Tost B were analyzed to deter- 
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mino internal coaeisloncy and to diiicovcr items which should bo 
cliscardod or reviaod l>ecftuse they were not discriminuting. The 
eighly-cighl papers were divided into two groujiH: the upper group 
waaoompemed of the fifty iKsreent who received the Idghcst scores; 
the lower groiip of llie fifty per coni who received the lowest 
scores. Tlie perccnlngo of corrcel responses for each item was 
dclermiruifl for each group. The ileina were, thru analyzed to 
doleriniiie (1) llioHC ftjr which eiieli group had iIjc wnru? percentage 
of correct responwH; ('i) thoae for which the lowc^r group had a 
higher percentage of correct responsen; and (8) ihose for wliicli 
the diltoronoo in percentage hetween tlie two groups was less 
than 10. All except tliirtccn of the wixLy-two ilcins in Test A, 
and thirty itciiia of the one hundred Ion in Teat B, were satis¬ 
factorily discrimiimting. 

In a leacher-crlucatinn program it woiihl he valuuMi! if devicoa 
which could he adiinnlKtcretl oaNily were avallnhle, so that a 
prediction of what a tciudici would do relative to the up\>licivtion 
of principles when he la faced with a real-life situation could bo 
made. In the prcvHcut atudy paper-aiid-pencil tewtH which luivo 
high corrclalioiiH of validity and which cun he umsl as the indc- 
ponclcnt variables in computing ro.gresalau eciuationa have been 
developed. For the criterion, the iiilcrview-oliHervuli«)n score, 
wluci\ was used as the cleijcndcnt vnriaiilc in determining regres¬ 
sion, the validity was nasumed. 

If n rolaUonahip existR between two distributions it becomes 
poRsibIc to predict values In one diHlnhutioii from known values 
in live other. Regression lines aro developed for live, purpose of 
estimating vtduos of oiio vuriuhlo from known valuits of another 
vatiabio svilhin the limitn of the data which ivve availaide. 

In tho following discussion of rcgrciisioii, the Kcorcs on the two 
testa and the interviews and observationB will im designated by 
these symbols: 

Xi “ Test A: Recognition of Principles Test 

Xi « Tost B: The (laao of Jacqueliiio Cronor (Hhorl-anawor form) 

Xi *= Tost B: Tho Ctwo of Jncquclino Cronnr (essay form) 

Yi «= Tntorviow-ol)sorvation. 

There wore tliroo main problems to be conHidored in analyzing 
the rogroBsion data. The first problem was; (’an a regression 
equation >Yhich will predict toucher behavior in a rcal-lifo sitim- 
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tion with reasonablo accuracy be determined? The second prob¬ 
lem was: How accurate would the prediction be if only the short 
answer tests, Xi and were used? The third problem was: To 
what degree havo all factors determining teacher behavior 
relative to applying principles concerned with adolescent devel¬ 
opment in n real-life situation been measured by the regression 
equation? 

The intovview-observation score was obtained from information 
relative to bow the teacher applied principles concornod with the 
developmental needs of adolescent girls in a real-life situation. It 
was detormined by the use of a scale which had a range of 1 to 15. 

The first problem was to sot up regression equations. The 
equations using all throe variablcB is: 

Y == -0.0096 '-■.2235Zi -|- .2656J^3 -1- .2517X2 

The equation using two variables is: 

r = .074lXi + .2644X2 - 6.9562 

The equation using one variable is: 

Y = 2140Xi + 1.9382 

To ascertain the usefulness of these equations it was necessary 
to determine the multiple cocflicicnts obtained when all variables 
were used or progressively dropped; to dotermino the standard 
partial regression correlations holding various ones of the vari¬ 
ables constant, and to snake testB which indicate the significance 
of regression coo/Rcients. 

The multiple correlation coeffleient obtained between all 
the estimated Y values and the actual values was .9366. This 
correlation for the throe pencil-and-papm* tests combine is suffi¬ 
ciently high to give reasonable confidence in prediction of the 
ability of tenohers in this area. 

The multiple is .8773. This correlation means that 87.73 
per cent of the variability among teachers in their ability to apply 
principles in tliis area can bo measured by the three pencil-and- 
papor tests. 

If in Test B, Xs is omitted from the multiple correlation, 
becomes .8394. Thus tlic diffcronce between the multiple 
based on three independent variables and the multiple R^ based 
on two independent variables is .0424. If one independent 
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vumbk i« dropped from Urn Hpmtion nn nrlditumnl 1.21 per cent 
o( the varinlilUly irmainR unacpoimlM f«r l»y rt’j^rpRsum. 

The rtlnndjird partial iri^reti-xinn i’fn*flipieiif, HjMuMfieH nhnnges in 
T, independent of the chnnKerf in ihe olhrr iiuh‘peinleiit vnriablcjj 
and Ih the he«l ineaNiirc of whieli viiriaiile Ih the inoRt iiiiportunt 
in prtidicliiig V. Tl»e h* for eneii of the iJiree teM.s in: 

A’I «.fliaw 

Xt I.M02 

X% 

U is ohvioiia Hint Xi in llie moal iinporUml lesl in i)redieling T, 
aiuec. i\w, alandurd partial c<K*(fiele,ul for it is the highest of the 
three. Icstfl. 

Standard partial regreKsioi) coeflieieiita may nl.so la; used to 
judge which of ilie indeiHaidcnl viiriaidea urn iiiosl important in 
putjmaling V. If A'jisheld eonMtaiilnnd .Yj i.s compared witli Y, 
the correlation \» low --.01W), If .Y» ia held eonhlnnt and Ki is 
compared witli Y the eorrelulioa is low -.1071. 

If wVi is held eonstnnt the eorrolntioiot helween A't and Y, and 
l>ctwe(*n A'a and V i»rc: 

rrt \ »» .M'lO 

rri. i .*1577 

When Xi is held constant the correlationH hetween Xi and Y, 
between Xj and Y, and between A'l and Xt are: 

m.* =» .1071 

rrj. j “ .4*131 

rw.j - .7840 

■\Vlicn AMs held coii.slant, the correlnUon between X» and Xjis: 

rij.i = .0019 

Wlion oacii independent variable ik coni])Ar(al witli T, tlic other 
two variables Ijcing held uoiiHiaiU:, the following cotTeluiion.s are 
obtained. 

rri-ai .4318 

rvi. li “ .r>8l8 

rvj. ij ^ .5*195 

Since all I testa coofficicids—*1.385, 5.385 and 0.559—aio 
highly eiguificant, each of the independent variables may bo 
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assumed to bo related to tho depeadent variables in a linear 
manner. All three also oontributo to the total rogression, and lor 
the most accurate prediction relative to the ability of teachers to 
apply principles in this area, all three variables should be measured 

Tho extremely high value of multiple fl'-.8773-i8 evident of 
tho euceess with which individual predictions may bo made 
when the three independent variables selected in this study are 
used. 

Throughout the fitatifttical analysis, Xa, the essay form of Test 
B, The Case of Jacqueline Croner, has proved to be the least 
valuable of the variables to uso for prediction purposes. It has 
tlio smallest standard partial regression coefficient, the smallest 
partial correlation with Uic Y variable, and the smallest t value. 
It seems, tiicroforo, that it is justifiablo to drop it from the regres¬ 
sion equation, nncl lose a very small part of the total predictable 
information in favor of moro easily administered and time-saving 
tests. 

Tho recommended regression equation obtained is: 

K = -.074LYi -h .2C44Xa - 5.9562 

Tills Y variablo may be predicted for individuals by measuring 
tho and Xi vnriablc.s, a task which would take considerable 
time, since approximately one and three-fourtbs hours are 
required for oaoh individual to road the two te.sts, and additional 
time is nocosHary to score it. 

It can bo reasonably assumed that the ability of individuals to 
apply principles can be men-suicd by iiic use of Xi and X 2 . 
These tfi.sLs sliould make it unnecessary for teacher-educators to 
expend lime, energy and money in visiting widely distributed 
schools for the purpose of obsemiig teacher,s in their class¬ 
rooms and, during exCra-cuiTicular activities, of interviewing them 
and consulting their administrators. 



THE USE OF IJTEllAE GIlAEES 

TRUMAN I,. KEI.Lr,Y 

HauU liarltarA, CftliforiuDL 

A Rywli'in of rating, nr clniwiryiiiK, hlu<lrnlH by nuiaiiH of loUorg 
A, /i, C, ciU’., or K (oxroU^nl), U (gooil), otc., jh oiOh'fl n lUcrul 
grntling Hyntcsm. It coimtjoitly given an orcler of merit of groups, 
with no very prccino fjimntiltilivo relutionshipM liolwcen tlio 
litoral graclofl. 

The* clislaate of the Ktatmlician for literal grudr.s itt fully iustified 
on two counts: CleiiGrftlly hut few claascs are employed ho tlnifc 
there is a large grmiiiing error and aa Iho literal grtulen provide 
an ordered aeries only the quaiUiluUvc relalioimhips lictwcen the 
classes is unknown, here propose litoral grades wldclj shall 
have these nhorleumings to m Hmall a (h’grce as possible. A 
solution ia puwiiblc if the form of (Ualrilmtion of the trait being 
graded is known. 

We Khali nsHumo a normal diHlribution of tulonl, arguing IhaL 
the ftbvUticHj prCRaures nml intovCHis that I>ring HluilentH into 
clusHOH tend to produce a homageueous group, Lliat is, a group 
that docs have a modal ahllity-pa*K8ure-intcrcst eharacteri.sLic 
and frequency falling off from Una morle in both direclicms in a 
somewhat normal manner. 

For notation we uho the following: The elnss given tbo literal 
grade A is the highest ranking chuss, the next higljost eliiss lias 
literal grade H, ole. The A class is the tail of a normal dintri- 
hution. AH.suming a unit normal distribution iU mean is A, its 
tempered cliujs index (described later) is A, its upper limit is 
infinity and ita lower limit which is at the boundary between 
classes A and li ia xau, its ordinate at tiie lower boundary ia zah, 
the number of eases in the clans w Qa, which ia identical with qAo 
the proportion to the right of the point xa , u , the variance of the 
moasurca in elasa A from the class mean A is V'^, and (inidly tlio 
menu squared deviation of the moasures in lliia cIuhs from the 
tempered class index. A, is hero called lh<i class variance and is 
labelled Va- For class H we have notation 

5 = close mean 
B » tempered class index 
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xad = upper clasis limit 
Xbo lower class limit 
Zad = ordinate at the upper limit 
zbc — ordinate at the lower limit 
qb = qua ~ Qab ~ proportion of coses in the class 
Vi = variance from B 
Vb = varinnco from 7i 

Of course wo use similar notation for nil other classes. 

Except for a two-class system, A and B, or a thrce-clasa system 
A, and it is impossible to have class means such that all 
dilTcrcnCGa between neighboring means are equal. However it is 
almost universal to assume that the A pupils are as superior to 
the B pupils as the B pupils arc superior to the C pupils, etc, 
Since A, J5, C, D, etc. do not show equal differences we modify, 
or temper, the sonic employing indexes A, 5, C, Z), etc. upon 
which has boon imposed the condition A-B^B-^C^ 
C — D, oto. This is the first imposition that wo make. The 
second is that Clio class limits shall bo so chosen that the variance 
error of ostiinaLo duo to grouping 

V«i< — qAV A + qoV D + qcV c + etc. 
shall ho minimal. 

Even when tlioae in a doss, say 5, arc correctly assigned to the 
class there arc orror.s when all are given the same mark B, for 
in ability they range all the way from xbo to Xad. The variance 
of the measures from B is the varinnco error duo to grouping for 
those graded B. Tliis is not the total variance error of estimate, 
which is equal to the variance duo to grouping plus the variance 
duo to misjudgmoiit which has placed individuals in wrong classes. 
We hero only attempt to minimize the error due to grouping. 

Wo shall not linger over the two category case for it is surely 
axiomatic that to minimize the grouping error the proportion 
in the A class should be .50 and the proportion in the B class also 
be .60. 

It is obvious in the three category case that the proportion in 
the A class must bo tlic same as that in the C class, so class means 
A, 75, and C must bo equally spaced and thus constitute the 
tempered class indexes A, B, and C. Utilizing formulas [8:26] 
and [8:29] of Kolloy’s Fundamentals of Sialislics, 1947, we obtain 
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Va 
Vb ^ 


jr I ] ^AbS'AB 

V C I -— 

9a 

\ — 

I 'iilAB 



WfiRhling lIiOHO llirnti vnrmnpeH by Ihe rrMprcfivc proimrUoiiH 
in.volvpcl wr' (ibinin Iho fmtclioti wbicli wo dfHirn in ininimizo. 
The. minlmiini cktum whfn zab *** ^iyxXAB. U in inlrrcMling to 
noUi lhal tluM i« tlic »»»uno cdtxlifton hk (htil wlui’h givew Ihc 
noewafy uijprr ami lower luil piiriiona of » ntirnml (liHtdbution 
lo maximize the critical ratio of the dilTcrcucc lictwucii means of 
tail portions over its stunclard error (see Kc'II(‘y, Fumiamcnloh of 


Table I.—Tiiubk Oin'iMAL (Trasses fob a IUrio Unit Normal 
DiariuBUTioN (0 *« 1.00) 



Cliut)) 1 

I/jwcr 

X 

[.iiniU 

Upper 

X “ 

Pro- 

iwr- 

liunH 

in 

Cloiwcti 

At^inal 

C'lAAt4 

Mcuiih 

Tempered 

Olanrt 

ludexcH 

' Inlra- 
cln»s 
Van* 
unco 

from 

ClftJiH 

McniiB 

A 

.01200 j 

w 

.27027 

i.22-10n0‘l 

1.2210001 , 


n 

-.01200 ' 

.01200 

.•15040 

,o(«)oneo 

.(KKKKKH) 

mEm 

0 

_ eq 

-.01200 

.27027 

-1.2210001 

-1.2210001 

.25000 





.10017 


Slniidnrd error of mcmiurcmcnl duo to grouping. 

.13009 


Slatieiics^ Oli. viii, See. 8). At thts point qa «= .27027 and 
xao “ .01200. Table I herewith is given to facililatc coinpaiison 
with later lablcH for 4, 5, and G category clnssifioationH. 

The number of decimal places in the lablo-s which follow is, 
for most puvposert, excessive. They Imvo been ro))(u'te<l to this 
largo number of plaec.s for two reasons. In the case (d Table II, 
and the lower limit of chias A, it won niwesHavy to compute a 
largo number of decimal places tu oslabli.sh, indubitably, that 
the class limit was not exactly one alandurd deviation from tl\o 
mean. In all tables, to eecuro proportions correct to three or 
four places many additional places wore necessary in the class 
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limits. Any ono desiring to check the writer's work, or to pro¬ 
ceed further with this sort of determination^ will need the eight- 
decimal place values of * as given. 

The determination of the proportions entering into the optimal 
four-class system was accomplished by cut-and-try methods. 
The outcome is given in Table l\. This is easy to remember 
because Iah is almost exactly one standard deviation. 


Table II.— Four Optimal Classes for a Basic Unit Normal 
Distribution (0 = 1.00) 
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Using the same laborious methods solutions have been obtained 
for five-class and six-class systems. The results are shown in 
Tables III and IV. 

Our general conclusion is that there can be an improvement in 
litoral grading systems if the proportions in the classes are well 
chosen. The well chosen proportions, if the trait is normally 
distributed, are given for three-, four-, five- and six-class systems 
in Tables I, II, III and IV. 
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MENTAL ABILITY RATINGS 
OF l-IONOR STUDENTS 

LILLIAN G. PORTENIER 
University of Wyoming 

Do all honor Btudonts earn superior ratings on tests oi mental 
ability? What is the range oi mental ability scores for students 
upon whom a given honor has been conferred? How widely do 
1 mean mental test acoros vary for students receiving different 
honors? To answer these and other questions, data were com¬ 
piled for studonts who were the recipients of awards and/or who 
were elected to various professional and honorary fraternities at 
the ‘University of Wyoming during the twenty year period from 
1929 to im. 

In common with moat institutions of higher learning the Uni¬ 
versity of Wyoming attempts to promote interest in, and to grant 
recognition for, outstanding work in the diflorent lines of activity 
by election to various collegiate honorary societies, and by con¬ 
ferring awards, prizes and scholarships. Printed programs listing 
the honorary olcctions and awards are distributed at the ‘Honors' 
asaombly hold annually during the latter part of May. Copies 
of the twenty programs from 1929-1949 furnished a complete list 
of tho honorary olcctions and award recipients for the period. 

Since the Ohio State University Psycliological Examination 
has been administered to freshmen at the University annually, 
beginning with the fall quarter 1929, scores were available in tho 
personnel files for most of the honor students. Successive forms 
of tho 0. S. U. Test from Form 14 to Form 23 wero used during 
tho twenty years. To secure comparable scores for students who 
had taken dilTercnt forms of the test, percentile ratings based on 
freshmen norms were used. The mean and range of the per¬ 
centile ratings for stiulenls receiving each of the honors listed 
are shown in Table I. A study of these data reveals many 
significant facts. First, there i.s a very wide range in percentile 
ratings for the recipients of most awards, in a few cases from tho 
lowest to tho highest decile. For the Phi Beta Kappa awards 
only were all the porcontilo ratings in tho upper quartilo. The 
moan porcontilo ratings for the recipients of awards from the 
honorary fratornitics are higher than the mean ratings for 
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Tablk I.—IIan’oe and Mean op Pehcentilk Ratings on the 
0. 8. 1;. TK8T POU v^TUPKNTS IlKCEtVING I’UOFKSHIONAL AND 
IIONOHAIIY I'KATEILNITY AwAIIDA AT TIIK UNIVKHKITY 
OP WvoMiNcs, 1029-1919* 
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OulsUinding proinedieul rrcsliman 

8 

09 09 
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Kduo. frcuh. and soph, wilh liighcat 
Bcholaatic ave. 

40 

20'100 

84.9 

Pin Beta Kapi)a 

Graduating Hcnior wilh higlical aoho- 
laatic ave. 

10 
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82.4 



495 


Mental Ability Uaiings of Honor Students 


Tablb I.— {Cordinued) 


Num- 



Organization 

her 

Range 

Mean 

Pi Delta Epsilon 

Outstanding first year Branding Iron 
reporter 

15 

46-100 

78.7 

Psi Chi 

Undergraduate sliowing promise in psy¬ 
chology 

9 

71-98 

88.6 

Sigma Tail 

Outstanding freshman in Engineering 

9 

12-98 

81.0 

Tlieta Alpha Phi 

Outstanding actor and actress in the 
Uuiv. Theatre 

40 

29-99 

76.2 


* Many of tlio above fraternities hnvo been inatalled at Wyoming since 
1929, and some awards were not conferred annually. Most of the awards 
were made for at least ton years although O. S. U. scores were not available 
for all recipients. 

recipients of awards from professional organizations, Phi Beta 
Kappa (90.3) has the highest mean rating followed closely by 
Phi Kappa Phi (80.5). The lowest mean ratings were found, for 
Alpha 5iola (59.1) which confers award on the freshman earn¬ 
ing the highest scholastic average in the College of Agriculture, 
and for tho American Society of Mechanical Engineers (63.0) 
which recognizes outstanding work in the Student Branch of the 
Society. The mean ratings for all other groups fall in the upper 
qunrtile, and with but two exceptions, Alpha Kappa Psi (78.6) 
and Pi Delta Epsilon (78.7), in the second highest decile. 

Most of tho 0. S. U. tests were administered to the students 
during the last semester of their senior year in high school or as 
entering freshmen at the University. In many instances the 
students did not realize the significance of the tests, and conse¬ 
quently their scores jnay not be reliable measures of the abilities 
tested. This fact pro!>ahly accounts for most of the low ratings 
listed under tho percentile range. However, many studies indi¬ 
cate that tho O. S. U. Tost, as well as most other tests designed 
as tests of general intelligence for college students, measure the 
abilities required for courses in the Liberal Arts and Sciences more 
successfully than they mcasui'c the abilities stressed in Agri- 
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culturo and ICnginoering cotirsog. (Seo ^cfer^»nce^) This fact 
is verified not only l)y Uic relatively low mean poreonlilc ratings 
for the rccipirnlfl of tlie Alpha ?^tn and A. S. M. K., awards but 
llkewiRo by llic ineon ratings for ilic students elcclerl to the three 
major lutnor societies i IMii llcta Kappa, I’hi Knppa Phi, and 
Sigma Xi, «s diHolosed in Tahle II- 

Taulk II. dUNor:, Mean, Standaui) Deviation, and ChuTiCAL 
IUtio ok I*eucent»,b Watikoh on O. S. U. Test kou 

iStUDENTH KlKCTKD to IIONOUAIIV (hlOANIXAnONH AT 
the Univkurity op Wyoming, 1920-'1919 

Num- 

Organiaalion her Range Moan SD CR 

Phi RcU Koppa 
Outstanding schohirfildp 
in Liiicral AMs and 

Sciences CO 28-100 02.02 12.85 

3.88 

Phi Kappa Plii 
Outstanding scholarsidp 

in any oollego 247 25-100 84.28 18.05 

4.00 

Sigma Xi 

Spcoinl aptitude for 
flcicntific rcBoarcli in 

pure and applied scionco 78 10-100 71.73 25.85 

O.OG 

The mean percentile rating (or Plii licla Kappa (02.32), which 
limits its membcrsliip to outstanding scliolars with their major 
course work, in Che Liberal Arts ami ScicncoB, is eight puints above 
the moan for Phi Kappa Phi (84.28), which elects outstanding 
scholars from any college, and twenty points higher than for 
Sigma Xi (71.73), which bases its recognition on spoeinl ai)titu{Io 
foT aoienUfio research in both pure and applied Hcienco. At 
Wyoming many studonU arc elected to Sigma Xi from tlio 
Collogoa of AgriouHuro and Engineering. The dirfcrcncGs 
between the means are significant for all three groups us indi¬ 
cated by critical ratios of 3.88, 4.00 and 0.00, respectively. 
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Tho variability in tho distribution of the percentile ratings is 
smallest in the Phi Beta Kappa group, S. D. 12.85, Only five 
(nine per cent) of the fifty-six Phi Beta Kappa students had 
percentile ratings below 75 and only one student below 60. Tho 
variability is far moro pronounced for the Phi Kappa Phi group 
as shown by a SI) of 18.05, and even more so for the Sigma Xi 
group with a SD of 25.85. Moro than twenty-five per cent of 
the students elected to Phi Kappa Phi and fifty per cent of those 
elected to Sigma Xi had percentile ratings below 75, while seven 
and twenty per cent, respectively, were below 50. 

Pailuro of the O. S. TJ. Test to measure the abilities recognized 
in awarding honors in the College of Agriculture and in some 
departments in Engineering is further indicated in the data on 
department honor books awarded to outstanding students in the 
various departments as shoAvn in Table III. Of the mean per- 
coiitilo ratings dofmitcly below 75, that is below the upper quar- 
tile, four are for departments in tho College of Agriculture; 
Agronomy (49.1), Animal Production (49.0), Home Economics 
(60.2), and Voterinary Science (53.6) and tho remainder in 
Mechanical ICnginocring (54.6), Law (65.7), Military Science 
(66.9), find Physical Education for men (48.0) and women (61.8). 
Tlio fivo highest ratings; Economics and Sociology (93.8), Chem- 
iatvy (92.2), I'lngVish (91.2), Greek and Latin (00.6), and Zoloogy 
(80.8); are for departments in tlic College of Liberal Arts and 
ScioncGB. It should ho observed that all of iheso ratings aro in 
or very near the highest ten percentile. 

It is also of interest to note that the mean percentile rating for 
students receiving the Gamma Sigma Epsilon award (80,8 first- 
yoav chemistry) is much lower than for the upper classmen 
receiving the department honor book in Chemistry (92.2), while 
the reverse is true for the Alpha Zeia award (69.1-agriculture 
freshmen) and tho recipients of the honor books in Agriculture 
(about 49) and also for the Phi Upsilon Omicron award (82.4- 
home economics freshmen) and the recipients of the Home Eco¬ 
nomics department honor book (00.2). Thus, it sooms that tho 
predictive value of psychological tests for determining students 
who may win honors varies not only with the departments but 
also with the particular honor conferred by tho department. 

Although many students may oarn high percentile ratings on 
psychological tests, only a very limited number of them receive 
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TabI/B in.—IU nqk akd Mkan’ of rFiiuBNTii/K Katinos on 
0. vS. U. Tkst fok S'rrhKNTH on "Whom Dki'aiitmiont 
IIONOI l }k)OKS Wkuk (’ONFKKUKI) 


ncparlriient 

Xuiiiljer 

llftiige 

Mean 

Agronomy 

15 

20 85 

‘10.1 

Anirnnl rroduclion 

Hi 

7-00 

-19.0 


17 

WA 99 

g'i.O 

Chemifitry 

18 

80 100 

02.2 

Cmnracrco 

HI 

02 100 

81.5 

Economics and Sociology 

10 

80 100 

03.8 

Education 

Ivlemenlary 

17 

15 08 

71.0 

Secondary 

19 

28 1(H) 

75.9 

Engineering 

Civil 

18 

21 KM) 

82.7 

Electrical 

1(1 

21 00 

74.2 

Mechanical 

17 

:Vl 02 

54.5 

English 

18 

(iiiKH) 

01.2 

Geology 

15 

dl 00 

75.3 

Greek and Latin 

10 

72 HH) 

00.0 

IliBlory 

17 

20 100 

85.0 

Homo KcunomicH 

10 

:h) no 

(10.2 

Law 

15 

11 00 

115.7 

Mathematics 

17 

HO 100 

82.1 

Military Scienco 

10 

8 08 

(1(1.0 

Modern Languages 

18 

28 100 

81.2 

Music 

20 

0 100 

72.4 

Physical Education 

Men 

17 

7- 05 

48.0 

Women 

10 

11 08 

01.8 

Physics 

17 

0 100 

77.5 

political Science 

10 

17 1011 

74.4 

Philosopliy and Psycliology 

20 

28 100 

85.3 

Veterinary Science 

15 

H 100 

53.0 

Zoology 

10 

8(1 00 

80.8 
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honors. This is due in part to the comparatively small number 
of honors awarded, but even more, perhaps, to the fact that many 
able students concentrate their efforts on extra-curricular activi¬ 
ties at the expense of grades, while others are handicapped in 
their study by emotional difficulties and various other personality 
maladjustments. For many students, winning honors is a form 
of adjustment. 

It would seem then that while thoro is a positive correlation 
between psychological test ratings and honor awards the honor 
recipients are not limited to students with high psychological test 
scores, and that many students who make high test scores fail to 
win honors. The percentile ratings of students winning a given 
honor from year to year and also for students winning different 
honors in various dei)artment3 vary widely, in some instances 
even from the lowe.st to the highest decile, 
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BOOK REVIEWS 


Carney liANDisANnM.MATUOitiKBou.Ks. I'cxthnokofAbnormal 
Psifchalogy. New York: *11ic Macinillnri CU)iiipuny, 1950, 
Pi), 031. 

The Krenlewl pr<jlilein of iiUMlern eivilisotlioii lod/iy \h iiol atomic 
energy nr InoUtgieal warfare iaiL in in llie iield of lininaii relnlioti- 
8hit)H. TIiIh \h one of the two fiindiuneiilul ideaa lhal the aulliors 
of lliia revirtcd text iti almorinul |»Hy«*liology liave kept in mind in 
aekcling and orgaii'ieing the iimlerhda for the revined edition. 
Tlie (jLher Ih that the hook written hy lliem live yeara iigo is 
outdated ti» a result of the voat amount of rtmeareh timt has been 
done in knowledge areas thaturo hasic to understanding abnormal 
Ijohnvior. 'I’licir wish Ik, llu*roforo, to write a revij^sd edition that 
incorporates this research and also heipa to enliglilen llic reader 
BO that liQ geU a wma of the signilicance of Ininmn relatioiiHhips 
out of it as well tts learning the facts ccHtcerning ahin>rinnl behav¬ 
ior from it. Adding iiUMlcrn re.Hcurch contrlhutionH, of eoui'HO, 
nocG&sarily inakcH it possible for them to eliminate inattTial Im in 
lino with modern tcndcncicB. Tho general patlerj), liowever, is 
similar in nature to litaC found in tho firat edition. 'L'he inatoriais 
are presented in five sections called Orientation, Varieties of 
Abnormality, Explanations, I’sycbopathology, and DiagnoHis 
and Tberajiy. Wliorovcr possible in presenting a proldem or a 
general topic they doHcribo the faeln known alnmt ll>e problem, 
explanations for theso lindings, and the pHyclu)l(jgy or p.Hycho- 
pathology l,)eliind it. Kuch chapter is folb>w(Kl by referonen.s for 
furllicr reading. The hook contains a fairly comprehensive 
glossary and an index m well ns a listing of acknowledgements of 
many ciuotations, figures, and tables used. 

The kind of material that used to coinpo.se a fiill-sizeil l)ook in 
abnormal psycliology is here included in ono section called 
" Payuliopalliology.” Treated hern arc ail the tlisorders of behav¬ 
ior; sensaliuu, perception, acUon, emolioKH, volition, impairment 
of intellect, aphasia and amne.4ia. The Hcction on " Vuric.tics of 
Abnormality" inclucleH the usual Imting, Imt gives mueli mure 
attention to facts recorded in recent literature about physical 
illness, physical handicaps, and personality adiusLmenta of people 
with physical handicaps. Tho section on "Explanations" 
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includes a discussion of heredity and environment, development, 
internal environment, and the brain. The chapter on “Psycho¬ 
therapy” includes a brief consideration of the most frequently 
used projective techniques. The section on “Diagnosis and 
Therapy" includes chapters on the law, psychotherapy, educa¬ 
tional guidance and counseling, and mental hygiene. 

Tlio chapter on “Culture and Environment" is relatively 
adequate and includes a consideration of psychopathology in 
different cultures; national, racial, and religious groups; war 
and economic depression; education; economic status, rural 
and urban rates. For some reason there are some omissions of 
well-known ecological studies of behavior. The viewpoint in 
this volume as in the first is eclectic iind a conscious attempt is 
made to build up in the reader and the student who will use it as a 
text a respect for facts and figures to weight evidence with and 
also conscious is the attempt to bo open-minded but preserve the 
skepticism of tho adcutist. 

Tho dilTorcncos between psychosis and neurosis are dealt with in 
lino with inodorn knowledge; namely, that people who are 
neurotic more chronically are not the kind of people who get 
psychoses. Alcoholics Anonymous is given a relatively uncritical 
treatment hero as in many other books recently written. Psycho¬ 
analysis, hypnoanalysis, and narcoanalysis are considered by tho 
authors as methods of getting around tho resistance of the person 
so he relates material which cannot readily be brought to con¬ 
sciousness. Group therapy, the method of the AA, is considered 
as forms of supportive therapy. 

All in all, this is a very comprehensive text incorporating 
materials and contributions from recent dovelopments of both tho 
biological and social sciences with due emphasis to research find¬ 
ings. The material is all relatively well organized for teaching 
purposes and there is enough here to begin the consideration of 
other problems that are not treated at lengtli. There i.s enough 
hero to serve the purpose of an adequate course in abnormal 
psychology or p.sychopathology. Generally .speaking, the people 
who have liked tho first volume for teaching purposes will find 
this volume at least as good and in many rcapccta better. 

H. Meltzer 

Psychological Service Center 

8t. Louis, Missouri 
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Roy M. DoKtMis Mmmjauv.t ItirnnAun Jonkh. //aTwi(»oofc 0/ 
Bnt'ploijc.t: Kcw York; McCJmw-lIill Book Co., 

1050, pp. aiit. UMi 

*riu'li(<Trttun^ ttn cmpUjy^pNplpplioii iRPxtPiiHvn liiit llip quality 
of pulilirMlHUiH ^liovvM with* varmBility. In an ufTfuL to liring 
l(»golli(T niininniil informiUitm fill hliKlia.s reporting rcHuUs of 
Bclcrlioii nipJhfMln Uio rniii|n\rr« f»f liiis vnluiin* f-\aniiii(*(l over 
twf^nly-onp rt'frTpnvre. ' 1*0 l»‘ ineludr-il in the linol 

liKl nf Imimlreil iwenly-wN yvfvrpiUM's ulistradvil a report Imtl 
to meet live rriterta; the lyj«* f>f vinployvi* ^peeilifal; lUo mnnher 
of fivihjeet« Riveu; IobIh utHHl nainf^l or <U’j<vrilaal; Uu*. eriteriou of 
joV» proticlvnoy explicitly Blivlwl; ami the ucluul (quautilativc) 
results ohUunod reported. It is an mtereHtiiiK ennunoutary 
on reweareli in tlim livid that Imroly anc;-liftli of the reports 
examined could ini'ot lhp«c niiiiiinul frilerin. 

For endi atudy in the finul colkTlion the nh.'ilrnet includes tho 
hihliogrnphle refornnee, the iiumher and flfj^erijilion of Huhjccls, 
tcetfl UNod, the jn)> profiweiiey erilmu, the validity data (per- 
conlngc«, cwrehitinn, diKtriliutioii, air.), iiiiil, wliero Kiveii, data on 
reliability. The enlricH are urniiigeil rhroniihiga*ally and iiichnlc 
HtudicH between 1000 nml lU-iO. There urr iialexi'H by job, teat, 
and author. The joli index IHh two hundred eleven ililTerent 
jobH including teacher (with fifty abKlnielK), Kehool ]>rinei])ai, 
library usKiKlaul, and dean uf women. 

This vohim<i MionUl prove imefii) for per.-jonni'l admini.slrator« 
nnd for vocational couiiHclors. C. M. bourriT 

Univermty of Illinois 


STANnKY 1 ). Toutvivs. 7 ’An Torkii.s ^fuz^. 7 V.d aad /ah,'hj‘i/L»icc. 

Pftlo Alto, Calif.; Pncilic Ikjoks, Itlfrfi, pp. Ill 1. 

Over a generation, pHyohological testers havi^ ])a.s.i(!d from 
dependence upon a few lest.s, chief among them tlm Biiud, to tlio 
active use of a larges number of tools omdi of which has .spis^ial 
inei'it for nomo j)in'i>o.sc.s. Among Uie lutler is the Porteus Mazo 
Test. Porlnus' now vohimo aHHcmidrs bi.s kimwh-dgc, c-spori- 
oncoH, and rofleclions relaitng to the Mu?.u TchI. 'I'ho imok is 
move Unm a manual for the teal, although it inebuh's inslvuctiuim 
(or ICBting, scoring guides, and siinilar (dinie.al heh>s. 

PortcuB discuusea use of the test in clinicul diagnosis, und the 
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implications of cliatigos in performance following lobotomy. He 
prcHenls a qualitative score wliicli has l)eon found to differentiate 
doliriquciils from control Rroups. Hotii of these will have interest 
for some practicing psyehologisls, although it appears that the tost 
ia beat trouted ns an oiiportunity for oI)8crving the subject rather 
than by nay objective scoring of the product. Two chapters on 
difforoncca among racial groups collect much material previously 
pv\l>li«hod in Kcattcred sources, and express the author’s view that 
such difTcronces on the Maze roflocL coiiatitutional factors. 

The book is mo.st of all a personal hi.sLory, recounting the long 
period when Vorlciifi' contnhulions wccq, i/i his opinion, over¬ 
shadowed by the 8lanford-Hinct. This retelling of our tribal 
conflicla is not without interest, but rortoua' anecdotes, quota¬ 
tions from curly sources, and retracing of the i)ath by which wo 
have modified (j\ir interpretation of the Binct Lost seem lacking in 
prcHGUt-day reUwunco. ILU advocacy of the Mazo Teat as a 
clinical tool is wc'!ll-warrant(!(lj but he sooma to distinguish 
inudciiuatcly bet\v(!on what the Mtizn inoaHiircH and ‘planning’ 
os a general trail. T’ho Hlrongly-Iell opinions Tortous dropa are in 
turn intriguing and Hlinndating, aimising, and outrageous. Tho 
book is u lively inuincnlo of a psychological pioneer. 

Lun J. CnONnAcii 

l/nivomiTy of ihinow 

J. E. Wai.la(,‘ 1 ') VVAM.m. Children with Mental and Physical 
Handicaps. Now York: I’renticc-llall, Inc., 1949, pp. 649. 

Specialists in llio field of handicapped children will recognize in 
Dr. Wallin’s innv volunu!, Children loith Menial and Physical 
Handicaps, an anqditicMtion of his oarlior volume on the education 
of luindicupiicd chiklren. Eorly years of first-hand experience 
as director, supcrvi.sor, and in.sinictor in the fields of education 
and treatment of lumdiciipped chihlron has made it possible for 
tho autlior to write knowingly. In twenty-one chapters he 
covero most pha.sr.s of the fi<‘Id with tho (•luphasiH on tiiagnosis and 
treatment. Although the book is not divided into divisions the 
cliaptei'H group them.sidves in three largo divisions; namely, (1) 
Dol’inilion of conciqits, (12) ()lu.s.silieation proidemB, (3) Considera¬ 
tion of special typos. Classifications arc treated in terms of 
psycliological characteristics, educability and soeio-vocational 
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